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ABSTRACT 


The comprehension section of four commonly used 
standardized reading tests were analyzed to etree 
how effectively they assessed reading-thinking processes. 
The information obtained on processing activity identified 
two categories of processes - general and selected pro- 
cesses. The information obtained from the two categories 
were applied to several definitions of reading comprehen- 
Sion to help in the establishment of a theoretical frame- 
work for cognitive processing in reading comprehension. 

The data collected from the research suggest that it 
is not feasible to assess a process singly. In addition, 
the frequency of use of the selected processes vary in the 
degree to which they are assessed. There is also evidence 
to suggest that there are some general processes which 
are phenomena of the testing of reading comprehension. 
The effects of task demands and other variables were 
another factor found to affect the processing activity of 
the testing of reading comprehension. The cognitive com- 
petencies of the comprehension tests were discussed in light 
of general processes, task demands, frequency of use of 


selected processes, and complexity of test items. 
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CHAPTER 1 
INTRODUCTION 


Evaluation, using standardized reading tests, has 
been a topic of considerable concern for some time. 

Acland .(1976),,-Goolsby and Frery. (19/6), and Rogers (19732) 
express dissatisfaction with standardized reading tests. 
The relationship of standardized reading scores to reading 
instruction has been questioned. What specific reading 
skills are measured on a standardized reading test? Does 
the test specify the strengths and weaknesses of the reader? 
The questions are endless but the answers are not forth- 
coming. 

One possible solution to aid in the answering of the 
above questions is to look at what processes a reader is 
engaged in when involved in the completion of a stan- 
dardized reading test. Within recent years, reading has 
been viewed from a process rather than from a skills per- 
epeeuleu(om! bityalo/)) taelOw OOMaeeLnese apmOocessese ii tne 
Anabysis,Ofea standardized readingetest.,couldylead toymore 
constructive information about how children are actually 
reading and to provide for better implementation of in- 
structional needs for a student. 


This study, then, will deal with the analysis of four 
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of the major standardized reading tests in terms of the 
processes they assess. Only the comprehension section of 


the four tests will be considered. 


BACKGROUND TO THE PROBLEM 


When an individual becomes involved in a reading 
task, he must perform certain actions on the printed 
stimuli. There is a complex repertoire of integrated 
sequences of actions that a person uses to induce his own 
language and cognitive development. These actions are 
Called processes (Smith, 19/1. Fishban and Emans, 1972). 

These processes are covert mental activities that are 
not amenable to direct measurement or observation. With 
the exception of the most recent research, the field of 
reading research as a process oriented activity has been 
fragmentary (Walker, 1973). The absence of a theoretical 
framework has been cited as one of the major reasons for 
the lack of explication of these processes. Of particular 
importance is the absence of a theoretical framework for 
measurement of reading comprehension. 

Recent researches have especially expressed dis- 
satisfaction with our present reading measurement in- 
Setruments (arn, 196d. Goodman.) 19636* ‘simom..19/1L) { .sihey 
sugsest that the lack of diagnostic validity of reading 
comprehension stems from a poor understanding of the read- 
ing process. Schreiner (1977) suggests that tests must be 


created to reflect what is known about cognitive processing. 
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To develop such a test requires information relevant to a 
theoretical framework about processing activity as well 
as the knowledge that our present standardized tests can 


give researchers. 


PURPOSE OF THE STUDY 


The purpose of this study is to analyze four com- 
monly used standardized tests (comprehension section) to 
obtain information on the assessment of processing activity 


for reading comprehension. 


RESEARCH QUESTIONS 


In order to investigate the above purpose, the fol- 
lowing research questions were formulated: 

1. What reading comprehension processes do the 
stated standardized reading tests assess? 

2. What is the frequency of use of the reading com- 
prehension processes in these tests? 

3. Are some general cognitive processes phenomena 
of the nature of reading test formats? 

4 Does the test format force certain cognitive 
competency demands on the reader? 

SE li otiemaccunpelons ainnerent dim eceseancn ques — 
tions 3 and 4 are found to be valid, is it possible, to 
separate reading and cognitive demands and devise test 


Ltems to assess this? 
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DEFINITIONS 


Miesdelinition, of the readine processes was ori 
ginally established from the background literature. As 
the study progressed the application of the definitions to 
the reading tests created a problem so they were redefined 
in light of the analysis. ~All of Chapter IV is devoted to 
Enese cderinitions, A summary ©: (ime derivatrons Of the 


Processes can be found at the end cf Chapter IV. 


EIMUTATLIONS, OF THE YS FUDY 


ie The cwesults of this study in assessing the stan-= 
dardized tests for processes are specific to the stated 
tests. Only the format of the study can be applied to 
other tests because the results of the study are specific 
to the tests of the study. 

2. The results of this study are obtained from one 
researcher's analysis of the tests and data and, thus, 
fimi tothe validation of the study. 

3. Tests involving oral reading comprehension were 
NobeIuCLUuCed Wiech sestucdy:, 

4. Since the processes were so numerous in the 
literature, the researcher made the decision as to pro- 


cesses commonly involved in reading comprehension. 


OVERVIEW OF THE PROCEDURE 


The procedure used in this study involved the 
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choosing of four commonly used standardized silent reading 
tests to see if they contained cognitive processes. The 
data was collected on score sheets by analyzing each item 
of each of the tests to see which processes were assessed 
by that item. The score sheets for data collection were 
Used CO sdialyze the data... Thetinitial data revealed two 
groups of processes which were named general and selected 
processes. This data led to redefining the processes in 
view of the initial data and analyzing the information a 
second time using the two groups of processes. 

Extraneous variables, such as task demands and 
response modes, were discussed in relation to the findings. 
Comparison of the results for processes within and across 
tests was the final data analysis. 

Approximately 25 percent of the items were col- 
laborated by two other judges to obtain an inter-judge re- 


liability. 


SIGNIFICANCE OF THE STUDY 


Research has indicated a need to know more about the 
assessment, of thermprocessing “activitywin meadings Sif the 
present study reveals that commonly used standardized tests 
do assess reading processes, then the information obtained 
may be beneficial in the modifying of present tests and in 
the construction of future tests for processing activity. 
In addition, information may be found that will help in the 


development of a theoretical framework for the assessment 


pista deathe 


at iaivstciete, ova tse deonikeannrs 2 i. aga 09 22482 
mer doen gageybebis qd vised sree ae tisamebten sew inal 
| heszeee shew poeussotd roitw 492 oF 2tees sat Jo re 

etae @aisosl loo ssab sot cseetla oxave att weth ted3 ye 
qua fissagues atab lafsial siT -eseb et2 osgsane oF bo may 
bugueiva bas. letausg Sota setae soANy saeegoesg ho aquezg 
@? éseeesorg cit eninitetisz. 52 bel aces 2rgT .satensosg 
as \mobzem@dtnt eda eeiselace bes’ sigh iaia tat @As Yo welv.) oJ 


seseoorg 10 2uud yy ows sf? antev oaks) bueges 


bana ebratwst xens. er jase  eplisiuey evesnasoee 
wgns@nkt 404 02 notzels= nl lbetawgel saw ,asiom seneqeat 


snovsn bee mistigin ebevarwve 03) esltiseay esta Io moatsnqaod 
» 


stuylsgon ssé> inal? sfz esw wiess 
~fba “Straw komse a6? So cnectod 2. wihisnkkougee 


<4 hit cast me Beedde os eaabu! s5rS0' ows ¥d beterodal : 
es litdesi 
yr Sie te ShmaS i TNREe 


cavers avon worm ot, besa is Haver tial. see Lotgseer 
a) UW .eedbess - ba ai prmnnnssss als ¥6 : 


Of steading. 
The development of a theoretical framework for 
assessments and/or a reading process test could have im- 


plications for developing reading programs in the future. 


ORGANIZATION OF THE STUDY 


The study will be presented as follows: 

CHAPTER II - A Review of the Related Literature. 
This Chapter includes a definition of reading and several 
definitions of reading comprehension as a processing ac- 
tivity. Aspects of testing reading comprehension are dis- 
cussed. 

GUALPIERA ii Desien ob thesocudy., "(nis Ghapter in— 
cludes the design of the study, data collection and 
analysis, and the veliability of the analysis’. 

CHAPTER IV - Delineation of the Processes. This 
Chapter includes a clarification of the definitions of the 
processes in relation to the initial data analysis. 

CHAPTER V - The Analysis and Findings of the Study. 
This Chapter includes the analysis of the data, discussion 
of the analysis in relation to the two categories of 
processes, and the comparison of the processes within and 
BclLOSs beso. 

CHAPTER VI - Summary, Conclusion, and Educational 
Implications. This Chapter includes a summary and con- 
clusion of each of the five research questions as well as 


the educational implications of the study. 
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CHAPTER] Ui 


REVIEW OF THE RELATED LITERATURE 


This Chapter develops reading comprehension as a 
processing activity by presenting a definition of reading 
and several definitions of reading comprehension which in- 
volve the complex mental processes. The relationship of 
the processes of thinking, memory, and reading compre- 
hension are explored as well as the nature of testing read- 


ing comprehension as a processing activity. 


GOODMAN'S MODEL OF READING 


Before this Chapter attempts to define reading com- 
prehension, a part of the reading process, a definition of 
headine wwillabe supplied.) Carrol (197/0))) Goodman, (1970). 
Pearson, (19/6). Smith (971). and cfhers Have drawn atten-— 
tion to reading as the construction of meaning. Reading, 
thet ts 7a constructive process (Goodman, 1963) in which 
level one deals with the reader's understanding of the 
graphic-phonemic, syntactic, and semantic features of the 
printed page. Level two deals with the interrelating of 
the sia ler Vind pee antouwlarcer Units) “linally smeaning is 
obtained in level three. 


Meaning is obtained through the construction or 
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organization of the information from the printed stimuli. 
The actions imposed on the material are a continuum of 
cognitive processes created by thinking, memory, and com- 
prehension (Furniss, 1978). 

The actions imposed on the material and the meaning 
obtained are reading comprehension. Reading comprehension, 
then, is a process-oriented activity which has as its ul- 
timate goal, meaning. To evaluate and compare this defini- 
tion the following two sections present two views of read- 
ing comprehension. Both definitions acknowledge that the 
reader interacts cognitively and affectively with the 
material which results in a final response containing some 


level of meaning. 


THORNDIKE'S DEFINITION OF READING COMPREHENSION 


Thorndike (1917) put reading comprehension into a 
sinelesstatement, “reading is thinking. ~ His following 
definition of reading comprehension has survived 60 years: 


Reading comprehension is a very com- 
plex procedure involving a weighing of 
each of many elements in a sentence, 
their Oregani zation in the proper relation 
EOMONe another the selection of °certain 
of their connotations and the rejection 
of others, and the cooperation of many 
forces to produce the final response 
(pe Si23)e 


Anwanalysis*of Thorndike s definitiron reveals *the-impor= 
tance of memory and thinking to reading comprehension. 


The use of memory and thinking can be seen by looking at 


Gray's (1960) Major Aspects of Reading as well as 
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Gi SPordiom( 1959) iseeictureto tm Ehe intellect. (Grays model 
is connected to Guilford's model by a section on the re- 


lationship of thinking, memory, and comprehension. 


GRAY'S MAJOR ASPECTS OF READING 


Gray (1960) states that reading is an extremely 
complex process. He broke down the reading process into 
four major aspects - perception, comprehension, reaction to 
whats eréad .eand fusion of new tdeas and old. The first 
major aspect will not be discussed since reading compre- 
hension is the focus of this study. The other three as- 
pects are considered aspects of reading comprehension. 

Assuming that perception has occurred then, the 
continuum of processes works, according to Gray, like 
this. As meaning associations are aroused, they are fused 
into a sequence of ideas. Memory is important to hold the 
meanings of the first words until those that follow are 
recognized. As meanings are recognized the reader reacts 
thoughtfully making judgements, responding emotionally, 
and combining with previous experience. Gray sees three 
essential elements of comprehension - to get a clear grasp 
of the literal meaning, to secure a fuller and more 
penetrating grasp of the message intended by the author, 
and to focus on the significance and the implications of 
the fauthor “Ss Adeasivas scontrasted with what he has osaid: 
Gray «(b960), refers towthese ‘three elements sas the reader's 
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Gray recognizes certain skills necessary for compre- 
hension. Some of these skills are the arousal of meaning 
associations with words, the fusing of separate meanings 
into a stream of ideas, the use of an inquiring attitude 
toward the meaning of the passage, and other skills. They 
develop the foundation of comprehension for the third 
aspect of reading - significance and implications of the 
author's ideas. 

As the reader secures a clear understanding of what 
he has read, he reacts automatically or reflectively to the 
ideas acquired. The reader evaluates what is read in the 
lzeht of *sound criteria or standards.» Thesrequisites for 
the reader's evaluation include - ideas acquired and auto- 
Mabtest eactiongtov theme anlindquirins saci i cudesecni teria 
of judgement (objective and subjective), conclusions 
reached, and emotional responses. The requisites suggest 
the actions that the reader must perform on the printed 
Stim lie 

The fourth aspect of the reading process is called 
assimilation and is acquired by fusing the ideas gained 
from reading with past experience, The relationshipmbe- 
tween the ideas and the past experience begins as the 
foader, adoptie aneingul ring  atticude:” “@ihesconcept.or in- 
Gutrine attitude or purpose is present in all four as- 
pects of reading.) The fusion of the old and new ideas 


result from the involvement of such mental processes as 
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analysis, comparison, selection, synthesis, and judgement 
(Gray, 1960). The product of the fusion represents new 
mental resources for use in future reading and thinking ac- 
EivLties'. 

These activities involve the higher mental processes 
(Grayrt960)0 ).Grayiiimp ies taeidepth yom processing!) (Craik 
and Lockhart, 1972) when he says creative thinking involves 
the imaginative treatment of ideas in both inductive and 
deductive thinking and results in new insights, fresh 
idéas .~-and new. organization of patterns) of thought.’ It is 
What. Stautcems(1969)) calls. extending yor refining what 
Ls psitated., 

Gray states that ''all mental processes that charac- 
terize clear thinking, sound judgement, and creative en- 
deavours" including attitude, interest, past experience, 
and biases are included in the reading process. 

The definition of reading and the viewpoints on 
reading comprehension previously presented imply a con- 
tinuum of cognitive processes involving thinking, memory, 
and comprehension. In addition, the material presented 
implied varying levels of meaning. The following section 
will further elaborate on the relationship of thinking, 


memory, and comprehension. 


RELATIONSHIP OF THINKING, MEMORY, AND COMPREHENSION 


Recent researchers and theorists in comprehension and 


memory suggest that the reader, in making sense of the 
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of complex processes to read and remember discourse 
(Furniss, 1978). Furniss states that "to a large degree 
the extent to which the processes are used are dependent 
upon the ability within the reader to implement acquisition 
and retrieval processes according to his purpose” (pe18). 
Her statement suggests variations within the processes in 
the acquisition of information depending upon the purpose 
of the reader. Her statement also suggests a strong re- 
lationship between thinking, memory, and comprehension. 

The relationship among thinking, memory and com- 
prehension can be seen in Stauffer's steps of the reading- 
thinking process (Stauffer, 1969). The three aspects of 
the reading-thinking process - declaring purposes, reason- 
ing, and judging - are fundamental for active assimilation 
of the printed stimuli. Stauffer suggests that “the 
nature of the purpose to be achieved fixes the answer being 
sought and regulates the rate and scope of the reading- 
Eninking process. (0.26). li, as Thorndike suggested, 
reading is reasoning, then the reader "manipulates the 
ideas to discover logical relations or he rearranges logi- 
Com patterns an Such a) Way that a conclusion can be 
Peacnea (stavutserm, 19697 .0.2)). -Stautter “adds “reasoning 
lee pEoductavVe Chinking and 1s to be contrasted with mechanz— 
cal responses to previously learned stimuli or reproductive 
thinking (p.27). Reasoning and purpose are necessary 


components of the evaluative process of judgement in which 
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the reader must "select and weigh the facts and make de- 
Cieiansethae are pertinent and discriminate” (py 27), The 
complexity of the evaluative process is dependent upon the 
task demands of the printed stimuli. These three com- 
ponents of the reading -thinking ‘process have, according to 
Stauffer, a fourth aspect fundamental to intelligent, 
maturetreading to)learni=ithatuis, refining and extending 
ideas. Stauffer is suggesting, then, that the reader is 
peblLOimming certain actions, Operations ,..0© processes on 
Lhe primtedestuimuli $enat srequiregacti veeseassimi latrongie: 
learning to take place. In regard to this suggestion 
Stauffer (1969) leaves several premises about the reading 
process: 

(1) The reading process is akin to the thinking pro- 
cess. 

(2) Concept development and cognitive structures re- 
quire early emphasis and soon take precedence over the 
mechanical aspects of word recognition. 

(3) As a person reads and comprehends, he acquires 
new concepts. 

(4) Hard-to-measure outcomes of critical and 
creative reading must replace tests that measure only 
superficial evidence of reading performance. 

From these premises one can see the role of thinking 
tolthe reading (process #jvAlso;talvaniety or achions fropera- 
tions, or processes must be performed on the printed 


stimuli to achieve different outcomes. Finally, attempts 
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to measure these processes should replace the more super- 
Ppoelaletests. 

The definitions of reading comprehension and the 
material presented so far show the importance of thinking 
in reading comprehension. The importance of memory will 
be developed in the next section as well as further 


developing the role of thinking. 


GULLFORD Ss SERUCLURE OF THE INTELLECT 


Guislfordesm(! 959) Gstructurceokl) thesintellect model 
illustrates some of the processes involved in comprehen- 
sion. He provides a three-dimensional model of the opera- 
ELONSMECONTeEnNENLandaproductsmoL chinkinomreLinpeas: Stautrer 
Sugeests, @therreadineyprocess/ is akinyto the: thinkine 
process, then the operations or processes suggested by 
Guilford are akin to the reading process. The reader 
Ehenucarcles out! variousszoperations ~thatems, = cognition; 
memory, divergent thinking, convergent thinking, and 
evaluation. Guilford suggests that the operations or 
processes combine with products and contents to produce a 
three-dimensional model for the structure of the intellect. 
He further suggests that reading is one of the most complex 
incellectual abiiietese(Guil tordhe 1960)" 

Thehma jorrtypeseotwthinkingrabilitiessthattare in= 
vOolvedwinereading are diversenteproduetion, convergent 
production, and evaluation (Guilford, TO 6ODPeelhesnature 


of the material in reading can determine the quality of the 
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intellectual abilities and the type of thinking abilities 
engaged. Guilford goes on to further suggest that the 
nature of testing materials and some reading materials re- 
quire general thinking abilities as well as more selected 
thinking abilities. The types of general thinking abili- 
ties assessed by the tests were specific to the task de- 
mands of the tests. In other words, certain types of 
tests will require certain general processes as a result 
OmmEhnewMees Lun ormatee Ora ligthestesessmentaoned. evaluation 
or judgement seems to be common to all, suggesting that 
this process becomes a function of a testing situation. 

Gumltondisamodelaisrimportant Lo; thisistudy since it 
not only acknowledges the operations or processes but also 
acknowledges a cross-over of the classification of in- 
tevlectienamel yey operationsy’ products; and Contents: 

This cross-over is important in examining the read- 
ing demands on standardized reading comprehension tests. 
The content and product of each comprehension test has to 
be examined to help determine the operations or processes 
that are general and selective to the specific comprehen- 
SLONI Lest. 

The four reading comprehension tests used in this 
studyahad tovbe examined using ther above) criteria? to ,de- 
termine which processes were general to each of the tests, 
which were general to all of the tests, and which of the 
processes were selective to each of the comprehension 


tests. The rationale for selecting the processes for this 
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RATIONALE FOR PROCESS SELECTION 


Difficulty arose when attempting to amalgamate all 
the literature to determine the processes used in the 
reading comprehension process (Walker, 1973). The defi- 
nitions of reading comprehension previously presented ac- 
knowledged the importance of thinking and memory to the 
comprehension process but used different terminology to 
describe the mental operations, for example, the arousal of 
meaning associations with words (Gray, 1962) could be 
EEOCOgni Elon and assoclatLtom (Smith 1975) and the refining 
and extending of ideas (Stauffer, 1969) could be synonomous 
with Gray's (1962) third aspect of comprehension - sig- 

Hi iecance and, implications of the author sv ideas. ~Addi- 
tional difficulty arose when the description of such opera- 
tions implied more than one mental operation. To overcome 
thesproblem of definitions Of processes), the researcher 
used the terminology found to be common in the literature 
for reading processes and defined themin terms of the 
models of reading comprehension presented before. 

Several factors were involved in the selection of the 
brocesses., ihe frequency Of occurrence 1m the iicerature 
Was ome Criterion. The criterion previously stated in the 
Guilford model was another. How closely these processes 
paralleled the definitions of reading comprehension pre- 


Sented betore was the tinal criterion. Using these 
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criteria, the following processes were selected: 

- recognition 

- association 

- prediction 

- inference 

SeclacssT~nicarion 

- comparison 

- generalization 
(2) sinduction 
(b) -deduction 

- sequencing 

- judgement 

- restatement 

- synthesis 
(a) phrase 
(b) sentence 
Ce discourse 


The processes appear in the order that they appear in the 
data analysis sheet in Appendix A. Since the processes 
were dependent upon the test format (Guilford, 1960; 
Stauffer, 1969), the definitions for the processes are 
provided in a later chapter as they result from the analysis 
of data. The definitions are based on the models of read- 
ing comprehension presented before but are specific to the 


bests usedsinethis study, 


ASPECTS OF THE TESTING OF COMPREHENSION 


Since the early 1900's, the field of reading has ex- 
perienced hundreds of standardized tests of a wide variety 
of reading skills and abilities. Standardized-normative 
tests have been the most common way of assessing a 
student's reading performance. Scores are compared to a 
HOrmine HOpulation €o put the student into a certain 
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grOuUp.. ~eResearch has’ ‘cast doubt on the validity and the 
reliability of all tests instruments in general and on 
Beouppstandandized tests in wparticulare(farr 11960), Farr 
further states that measurement has to be intertwined with 
psychology and the teaching of reading since research can- 
not substantiate that specific sub-skills can be validly 
measured. Simon (1971) agrees when he states that the 
degree to which extraneous variables are measured are not 
accountable in present standardized tests. Hunt (1955) and 
Farr (1968) both question the diagnostic validity of -sub- 
tests of reading. Goodman (1968) and Simon (1971) attribute 
the Lack iotidiagnosticyvalidity tovaspoor understandings of 
the reading process. Prentice and Peterson (1977) suggest 
there is a need to go to a psycho-linguistic definition of 
reading. 

A poor understanding of the reading process (Simon, 
1971), then, makes it almost impossible to separate a 
Student s cognitive skills from ‘his. comprehension skills. 
Schreiner (1977) suggests that if measurement instruments 
of reading comprehension are to have construct validity, 
they must be created to reflect what we know about cog- 
Nitivespoocessiie  mectautrera(!969)) im his. Gounth) premise 
stated earlier, reinforces the need of tests to assess 
processes. 

To assess processing what is needed is a theoretical 
framework of reading as a processing activity. Walker 


(1973) states that such-a tramework does mot exist, This 
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study is not attempting to establish such a framework but 
Coeproviderinrormation that will lead tos the establishment 
olesuch a framework, Rather, “this study is attemptine® to 
analyze the test items of four commonly used standardized 
reading tests to determine the degree to which the test 
items may be used to assess the processing behavior of 
students while they are reading. The results of such a 
study should help in providing information necessary for 
constructing reading tests that assess the reading- 
thinking process as well as provide information on process- 
ing in our present tests. 

The discussion on the structure of the intellect 
(Guilford, 1960) suggested the importance of content and 
products as well as the mental operations in the testing 
of reading comprehension. The next section will discuss 
aspects of contents and products which affect the testing 
of reading comprehension. The aspects of contents and 
products are variables which affect the amount and type of 


learning that takes place. 


VARIABLES WHICH AFFECT THE TESTING OF 
READING COMPREHENSION 


Reading is a demanding task. According to Stauffer 
(1969), it demands ''a command of thinking skills as well as 
reading Skills." "He defined the steps related to thinking 
and readine. These steps (found in an earlier section) are 


affected by variables (Thorndyke, 1975). 


i ettniiiat & gece aieth . cuctame <grimibante aa | 
iniiteiinieie iionw #iheamo, xvod 30 “emsss 5852 ots. ) oe 
Sees alts: dxbde qo’ Sengss sr oirlereyeb 02 stens cane 
We mebveriet grthawesetq els aestee Os b5eH si vem ames? 
@ @ova to. aa loees afl etna ors qors slidw etashese 
+95. GYendeten ralTamre at assed Prose id qiet bigete (hare 
syatige: u43 aceces iris cleat sakbase anisoirerenn: 
—ecas07% ho aciiemsotat shrvory af (lad neo seesose Qeeeeeee. 
egdeer? 27ezs%o TO) SR gee 
Sueigzesn) e445 *o suisomete SAT at notazyuont> aff 
bos @1seec 26 eareio¢c!l ads eTRSgauy (600. swt 
eeidie?d O82 «)] &e>*: to%e Leta ode a Llew sé etoubosq 
esever6 (Liw ate bio. yeerrT ocT loneyis ygioo- attbeewe to 
geisem) on? 356.7: roe etouborg Bea Si¢s3itos to ianeqni 
Oke esfeiaos to (Jseghe oT | Gotethpiargton ee re 
to-Sqyt bas. deed efi 144 tha Yosdy salistys? eo 


stele cede? sek? 


20 


Thorndyke (1975) states that learning with prose 
material depends on variables influencing the student's 
approach to the material. ''These variables include the 
task which subjects are required to perform, their purpose 
and goal in reading the material, and the constraints of 
Cnet processingsenvironment e(pyvs-4) 5 GAll of the vani- 
abllestare li mportantete thiesstudysy Learning Vis arfected 
Dymthese variables: ? elhertaskviseattunction of &textscharac= 
terrsties and ithertypesol processing activity .erihe type 
of processing activity on standardized tests is restricting 
and therefore puts constraints on the processing environ- 
ment. The main purpose of a standardized test, that of 
measurement, is already established for the readers. There 
may, however, be subsidiary purposes demanded of the reader 
iMecermseOGLethelspecific testecontent orgitems “The amount 
and type of learning that takes place in the completion of 
reading tests is limited. 

The present study, while not concerned specifically 
with learning, is concerned with the reading comprehension 
process which implies that some learning does take place. 
Thegsactathat stextecharacteristies;s response modes, and 
task demands change or vary within the four tests suggests 
that the reader will have to make some modifications in 
Gaskfexpectations and processing activity depending on 
these variables. 

Text characteristics and task demands determine both 


reading and cognitive involvement (Thorndyke, LOS) 2 Prose 
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Mbegrual differs from word lists not only in syntactic com- 
plexity but in its inherent organizational structure dic- 
tated by stich conventions as topic and context. Since the 
topic of each passage differs in the four standardized 
tests the amount of past experience that the reader brings 
to the response modes will be proportional to his fami- 
liarity with the topic of each test item. The response 
modes of the four standardized tests create a schema 
(BaEclett, 1932)) that allows for a higher number of inferred 
concepts (Frederiksen, 1975). 

The reader then is more than reconstructing ideas in- 
to an Organized array Of information, but is havine the 
task demands of the tests influence the number and type of 
processing activities. The task demands of the test in- 
Clude the organization Of information from the word devel. 
the sentence level, and the passage level. 

The text characteristics and task demands are also 
influenced by two types of response modes - multiple choice 
and cloze multiple choice. The response modes also affect 
the processing activities since the generation of pro- 
@esses 1s task sensitive (Thorndyke, 1975). 

In analyzing the processes involved in the reading 
teste pinalyzeq fon wihiswetudy, (these Veriaples will need co 


be considered. 
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SUMMARY 


Reading comprehension is a mental processing activity 
involving many reading-thinking processes. The ultimate 
goal of reading comprehension is meaning. The testing of 
comprehension as a processing activity has been neglected. 
Many variables were discussed in the testing of reading 
comprehension as a processing activity. 

The next Chapter will present the design of the 


study. 
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THE EXPERIMENTAL DESIGN 


This Chapter explains and describes the selection of 
Leatine tests, the dataranalysis. ana the reliability of 


the analysis. 


SELECTION OF READING TESTS 


The four tests chosen for analysis of processes in- 
volved in reading comprehension are: 
Stanford Achievement Test (Reading) (Form W) 


Gates-MacGinitie Reading Tests (Survey E, 
Form 2M) 


Metropolitan Achievement Tests (Advanced, 
Morne &) 


Geierehiete Peo ene Sei SUIS (erga Sars 
One form of each of the four tests was analyzed for reading 
processes. 

The four tests were chosen because they were the most 
frequently used standardized reading tests at the grade 
seven to nine level in the Alberta school system as in- 
dicated in, Report of Task Force on the Evaluation of Stan- 
dardized Achievement Tests for Alberta Schools (1977). The 
level of these tests which corresponds to the grade seven 
to nine level was chosen because of the researcher's back- 


eroulidein whe teaching of students at this level and the 


Zo 


iI. AATSARD 
WOd Ede | SAY ESM LASS eT 


So aalsseler ado dodiesesp fnn 2aleMaze organs elt : 
% woeliteries efz ins 2iiefshs 655) >A] ,ehes0 gakbany 
vievingn @@9 


YTOTT EMIGARH 80 FOtTTSRIee 


“rh @66259676 30 ciey lens aul pedo Sieso wel ese .~ 
"6 ttenato goo attest af Berloge 


ae 


(Wem@act) (tltesd) iae7 arsmsvalton bro 
S yar) RiasT Zs kel sho Ss pees a 
,5§522UbA) atest. tian ve tZob ae ticdig>-aolt 


_ y 
ACE MGT) ootige ited’ 35 siget yeaa) 


gnihee> ol Sosy lupe eeu etes4 “uct ods Fo. dade “wo, odd. and 


teow. sit Stew tes meena BSeouL S134 £235 sod att 
shrug oiy Je efes2 galbps. bes thixbonde toy 


a s 


us Foods. enaedlé sro ct Laval sokir os Tava 


; ’ 7 
4a, SIRS 2 S536 3 Feat Jo s2oggh é beveal : 


a ° 


a 


a. 


Tose 


24 


administration of standardized» testseat this level, “None 


of the stated tests were normed on Alberta populations. 


Stanford Achievement Tests (Reading) 


The Stanford Achievement Test was chosen for this 
study because of frequency of use at the Grade 7 to 9 level 
(Report of the Task Force on the Evaluation of Standardized 
Achievement Tests for Alberta Schools, 1977). The American 
edition of the test was used because the only significant 
changes made from the U.S. to the Canadian edition was the 
Substitution of metric units, which were considered in the 
Gask whorce Lepore, to be poorly constructed and invalid) (p. 
17). A further reason why the Stanford Achievement Tests 
were chosen was the ratings of the Centre for the Study of 
Evaluation found on page 78 of the task force report. The 
centre rated the reading comprehension section as "good" 
under the category ‘examinee appropriateness" and "fair" 
for “Administrative wsability and normed: technical ex= 
cellence." 

Since the study was concerned with the assessment of 
reading processes the reader is involved in when he is 
interacting with the content, the category “examinee ap- 
Peiateness was LMermost important Cacegzory. | iheretore, 
the good rating for "examinee appropriateness" was the 
other reason for this researcher to choose the Stanford 


Achievement Tests. 


The Stanford Advanced Paragraph Meaning Test, Form W 
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(1964, 5 pages) is a subtest of the Stanford Achievement 
fests. "it “consists of paragraph meaning only) “This “sab- 
Cesta lo erOUnc inte tie liretetave pares or the Stanrord 
Achievement Test, Complete Battery (Advanced Level). The 
advanced battery is primarily designed for use from the be- 
ginning of grade seven to the end of grade nine. 

The response modes for Stanford Achievement Test in- 
clude both multiple choice and cloze-multiple choice. 

ihe Paragraph Meaning Test, -according to the manual, 
COUs 1 Sts) OmlamseLles! OL palravrapns increasing anudirriculny. 
One or more words have been omitted from each paragraph. 
The pupil's task is to demonstrate his comprehension of the 
paragraph by selecting from four choices the proper or 
best choice for each omission. The subtest also includes 
complete paragraphs about which questions are asked, to be 
answered by selecting one of the possible choices. The 
total number of items is 60. 

The test can be scored by both hand and machine. 
Scores on Stanford Achievement Tests may be translated into 
grade scores, grade equivalents, percentile ranks and 
stanines. 

Reviews of the tests have yielded both positive and 
negative comments. Positively, Townsend’ (eltted im Buros:, 
1968) states that one advantage of the Stanford Achievement 
Tests is that the examiner can use the Paragraph Meaning 
Cubtec tlwLth, Of witnoucetie, restuor the battery. in 


addition, there are five comparable forms for each level 
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woichemakes 1t useful sforetestinge at alternate intervals 
fOr Comparison... Hobson (cited insBuros, 1968. page 1382) 
further comments positively by stating the test has good 
standardization and good content validity for paragraph 

Meawine up fLOecne send Of seyades 0c eerraxler, in a later 

Lreviewmin buros.(19/5)), adds another positivesaspect ict 

the Stanford test when he states that the latest edition 
of the test (1964) takes into account "modern changes in 
ERGCOLY wand epGactice Of readingwinsuructlonein techniques 
Of testing”. (page 382). 

Negatively, Robinson (cited in Buros, 1968) stated 
that the test which involves filling in the blanks cor- 
rectly depends on getting the facts or details and securing 
implied meaning but lacked broader goals than fact and in- 
ference. -Lownsend (cited in, Buros, 1968) afEiams the 
criticism of Robinson by acknowledging the limited pattern 
of reading testing. He further goes on to say that the 
Manual gives no description of reading parts. Such lack 
Of Anformation,. .acconaing «to Hobson Gerted in jBucos 11960): 
Make it daftfiicult wfor making use of andividual test results 


in an analytical or remedial way. 


Gates-MacGinitie Reading Tests (Survey E) 
The Gates MacGinitie Reading Tests, like the Stanford 


Achievement Tests, were chosen for this study due to their 
high frequency of use in the Alberta School System. In 


addition, the Gates-MacGinitie (Comprehension) was given 
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1dentical tatingsetoetheestantonrd testibyvrhesCentre for 
the Study of Evaluation Ratings ® (Report rot tilaskurorce, 
1977). The "good" rating for the "examinee appropriate- 
ness'' qualify it as a good test to examine for reading 
processes (page 78 of the Report, 1977). 

The response mode for the Gates-MacGinitie Reading 
Tests, Survey E, comprehension section is cloze multiple 
choice. Intermittent blanks appear in the passages for 
which the reader must select the appropriate word from 
five choices found below the passage. 

The Survey E level of the Gates-MacGinitie Reading 
Tests is) part of a series Of tests designed to’ cover grades 
i ehrough 22 This 1964 edition of the tests replaces the 
Gates Primary and Advanced Primary Reading Tests and the 
Gates Reading Survey. The Survey E level of the latest 
edition was constructed for grades seven to nine. The 
level contains three sections - speed and accuracy, voca- 
bulary, and comprehension. 

Only the comprehension of the Survey E (Form 2M) will 
be considered in this study. The following paragraph is a 
description of the Comprehension Test found in the 1965 
edition of the Teacher's Manual: 

The Comprehension Test measures the 
Student seapi lity tosreadscompletes prose 
passages with understanding. It contains 
DW pateacees ina whieheaetotaleormo2sblank 
spaces have been introduced. For each 
blank space a choice of five completions 


is offered. The student must decide 
which one of the five completions best 
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conforms to the meaning of the whole 
passage. The first passages are simply 
written, but the later ones become pro- 
Sressively more citficult (pace 1), 

Scoring of the answer sheets can be done by hand or 
by machine. The raw score of the Comprehension Test is 
the total number of items for which the student chose the 
right answer. The raw scores can be converted into grade 
scores, percentile scores and standard scores. The manual 
also allows for a comparison between scores, e.g. standard 
score on the Speed and Accuracy Test with the standard 
score on the Comprehension Test. 

The Survey E has three forms which allow for semi- 
annual, annual, or periodical check of progress from grade 
{ MCOnIe welneyvare. rors wii 2Meand OM. 

Reviews jof the Gates-MacGinitie Reading Tests reveal 
little. Burke, Powell and others found in Buros' Reading 
Hests and Reviews (L960, 1975) indicate lami tattons of the 
bests. | burke sand Powell = (Suros, 1975) suzesested that ‘the 
authors do not present their view of the reading process 
Ofmenelr rationale for the focus of the tests. “Much of the 
information not presented might be provided for by the in- 
formation obtained in the analysis of reading processes. 
Under the section of Comprehension in the manual, Burke 
questions the statement, ''the student's ability to read 

wwlen Underetanciig. since no wcetinitton, Of sunden- 
standing ls put forcm by the authors, Burke (19/5). and 


Powell (1975) (cited in Buros, 1975) and =Spache (cited pin 
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Buros, 1968) acknowledge the limited value of the infor- 
mation obtained from the tests if information is needed 
about specific reading skills and/or processes. Reading 
process analysis should provide one mode of diagnostic in- 
LOpuaLlonsinto the type or pinderstandine™ that the tests 
DUCDOLEEC tO measure. 

Spache (Buros, 1968) and Burke and Powell (Buros, 
1975) note that the tests measure comprehension that re- 
Quire; largely inferential thinking» As this is a skill not 
often stressed in classroom (Spache cited in Buros, 1968) 
the tests would not measure the same thinking as classroom 
performance. With such an emphasis on inferential think- 
ing, the analysis of this test for reading processes might 
provide useful information on the processes used to com- 
plete this, test... The comparison o£,the processes in this 
test to other standardized tests that assess higher levels 
of processing information should reveal the delimiting 
ertece Of eprocessing intormation tor reading comprehension 
in the Gates-MacGinitie Reading Test. Burke predicts such 
results in comparison when she acknowledges that the tests 
aoseca, processes in isolation, duejmainiy tosthe Veueth 
and the lack of development of reading selections. She 
does not, however, state what processes are being assessed. 


Such information may be provided by this study. 
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Metropolitan Achievement Test (Advanced) 
The Metropolitan Achievement Test was chosen for this 


study for the following reasons. The test was ranked 
Hourthe (Report, Of Taskiroresson the: Evaluattonmor Stan- 
dardized Achievement Tests for the Alberta Schools, 1977) 
on the frequency of mention by Alberta school systems re- 
porting the’ use of the tests; \) Ineaddition, -the®Metro= 
politan was rated higher than any other test at this level 
for reading comprehension. The test received a ''good"' 
rating for ‘examinee appropriateness" and "administrative 
usability" by the Centre for the Study of Evaluation Rat- 
ings as reported by the Task Force Report (1977). 

Under the subsection "Comprehension" of the category 
"Examinee Appropriateness", the centre rated "Item Appro- 
priateness" and "Item Relevance" full scores within the 
rating range. “Item Difficulties" of the Comprehension 
section was rated average. All other categories under 
the "'Examinee Appropriateness" were rated above average 
exeeptetor one, Administration of instruction: 

GBheahteheratinegs byethe Centresfone the studyi on 
Evaltation Ratings’ and the frequency of usevin the Alberta 
school system, were two major reasons for choosing this 
Ges Gs 

The Metropolitan Achievement Tests are a series of 
measures designed to tell teachers and administrators how 
much pupils have learned in important content and skills 


areas of the school's curriculum. The Advanced level is 


etme ented at 
8292 to eae en: no. easot gent Se ea 

(TOL alosgol hesadJA oH: 102 Stee? sosuevelded fb -" = 

“ot emaiers looioe satediA zd coitnen, te yanserew ad? ne 


“efSuM of! .cclatsbe i! -eve3e° sda 70 eet ots gaisaeg 


4 , _ 


Seval eisy *s gust tadan qos: cds wedatd bates caw mee or 
“heug” + havieses j5$¢-edl. .petaeefsianos gatbady wt, 
avisdetseidaiiie Tax “EEaAG, Sh MaeO? cys enpdiiexs’ Gos gobsax 7 
-seF aobgeuisva to wis was To) -st2GsD ens va “ae rada 
UROL) aregell oc VN Vegr Say +i bossoGer ae ‘eet 

WeG@ge4eo a5. 40 “rolansitargm’ sinatia i¢ SAS Febue 
“WUGGh-Gali YS. NTI ae es peg ee ose tunaatl”" 
ast acing, az) oe, Sb Sees {oF peat? fires "essnodsty 
Bol cansazyes) «so te ‘aqgtSfuoisaid msi OKs aatives ‘ 
whey eb tvup<sy eo eanto nik. ages: Salem wh - ° ihe 
egSrars avoda wate sa28 tigcandd id yiacehits miccompdiion 
mossau tial 16. 26ing <seln ian sun te% oqe 


4 < Fe-geusd Sty das ‘wiht sts! ed ina 


setacedio oii. nt sau 26 sd ads bre —— pacer 


oee 


deéswened to Gorresponda, to tne grades 7 to 9,5. 

The Advanced level, Form F, of the reading tests has 
two sections - Word Knowledge, and Reading. This study 
will only deal with the Reading section which has 45 
items. According to the manual, the 45 items measure 
‘public ability to comprenend written material” (page 2). 
After a pupil reads a paragraph he is required to answer 
questions which call for comprehending literally stated 
material, drawing inferences from a passage, identifying 
main ideas and determining word meanings from context. 

The response mode for the Metropolitan Achievement 
ESSe se ommuleip le choice. | Passages are 10 lbowed by aa 
statement which is to be completed by choosing the best 
answer from four choices. The choices include single word, 
multiple word, and phrases. 

The scoring of the test can be done by hand or by 
machine. Two manuals are needed, however, for full ad- 
ministration and scoring of the test. Teacher's Directions 
are needed for actual administration while the Teacher's 
Handbook is needed for the scoring and interpretation of 
the test. Norms for the tests were developed in such a 
way that each battery can be used in grades above and be- 
low those for which battery was primarily intended. 

Virtually all mew materials were created ton this 
edition (4th edition) of the Metropolitan Achievement 
Tests with all the material being tried out in classrooms 


across the United States. 
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In a review by Robinson, found in Buros (1968), he 
fates the Metropolitan as a good survey instrument. This 
evaluation by Robinson concurs with earlier statements by 
Hobson (cited in Buros, 1968) and McKim (cited in Buros, 
1968), when they suggest that the Metropolitan is out- 
standing for general estimates of paragraph reading abil- 
Ebene 

The advanced levels contain paragraphs aimed at 
measurement of four comprehension skills: main idea, 
details, inferences and meaning from words in context. 
What is lacking, Robinson, Hobson and McKim postulate, is 
a need to supplement the test for diagnostic purposes. 
Robinson says the tests authors need to "provide methods 
of analyzing strengths and weaknesses in the four com- 
prehension skills" (cited in Buros, 1966, page 312). Al- 
though the Metropolitan was lauded as a good survey, the 
low diagnostic value of the test led the reviewers to sug- 
gest a supplement for diagnostic purposes. Robinson sug- 
gested that a device for analysis be worked into the scor- 
ing. McKim suggested a supplement analysis. This study 
is attempting to provide such a supplement by analyzing the 
Metropolitan Test to see if the items of the test assess 
specific reading processes. Dignosis of a reader's in- 
formation processing, will enable the diagnostician to 
make judgements of how a reader is dealing with the 


printed stimuli. 
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Canadian Tests of Basic Skills 
HOsie eC. lab Noe 

DResna ine reason the ©. usb on was chosen torn Ehias 
study was because of its Canadian content and norms. 
Another reason was that Form 3 was constructed to facili- 
Late individualized testing at different stages of 
development (Teacher's Guide, 1974). Lt is also one of the 
four most commonly mentioned standardized tests used in 
the classrooms of the Alberta School System (Report of the 
Task Force on the Evaluation of Standardized Achievement 
LestesnoreAlbenta schools, 1977). In waddteLonm. te was 
given an overall rating of fair for the three categories 
- Examinee Appropriateness, Administrative Usability and 
Normed Technical Excellence. These ratings were obtained 
from the Gentwe for the Study of Evaluation Ratings on the 
owas bests OL basic Skills fromiawhich, thevG. lo beo. was 
adapted. Local ratings by the Technical Adequacy Assess- 
ment Committee of the Task Force rated the C.T.B.S. as 
OO y 

Tie Gul «BoGra Wace cnosen, Mthen. fOnetne = lolv owing 
reasons - Canadian, frequency of use, and ratings. 

Che sresponse mode tor the C.2.B 5. 12s the multiple 
choice format. For the reading comprehension section, 
passages of varying length and difficulty are read,  Ques- 
tions follow the passages and are to be answered by choos- 
ing the one answer that the reader thinks is better than 


the others. There are four choices to choose from for each 
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question with the format of choices ranging from a single 
word to sentences. 

The Canadian Tests of Basic Skills are eleven 
separate tests covering a wide range of skills development. 
The skills development are organized into six levels, all 
of which are contained in a single 96-page booklet. The 
section this study will be concerned with is Section R, 
Reading Comprehension section of the Levels Edition, Form 
oe 

In over 19 pages, Test R covers six levels ranging 
iEvomterades (3 to 9: > "levels %i3"and 14 -cover “the ‘skills 
development designated as grades 7 to 9. It contains 98 
items over 10 pages. According to the manual, the skills 
tested in Test R may be classed under four headings: 
details, purpose, organization and evaluation. 

The content of the test has been very carefully 
selected to represent ''the best of curriculum practices and 
to reflect current emphasis upon social utility and 
relevance for a diverse population (Manual, page 4). Since 
the data cannot be found concerning the Canadian Tests of 
Basi cuskilils. 2ts counterpart, lowa Tests of Basteuskilis, 
upon which the Canadian edition was based, was reviewed. 

According to Morgan, the Iowa tests are evaluative, 
that is defined as measuring generalized educational skills 
aver a wide range of ability rather than mastery of specific 
facta ox topics, Geited in Buros, 1968... page. 34) +. Thefocus 


#8 on eeneralized intellectual skills. Herrick (cited in 
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Buros, 1968) argued that the measurement of these intel- 
Pectualtbasic “skillis™is valuable aor use insthe development 
ODeinstructional and individualized needs . The reviewer 
further said) however; thatethe lowa tests do not pay 
Penodszhtattention tor theeappraisal of “those imtellectual 
processes and skills which are part of the process of know- 
ing and comprehending.'’ He went on to underscore the need 
for jehesraprdbexpansion Ob Mtestswinto tadditionaleareas of 
intellectual skills. It is assumed that the same needs 

can be generalized from the Iowa to the Canadian Tests of 
Basic Skills: The present study should allow for the ap- 
praisal of those intellectual processes involved in read- 


ing comprehension. 


DATA ANALYSIS 


Recording of the Analysis 


Each item of the four standardardized tests was 
analyzed for the processes, as stated in Chapter II, that 
were required to complete each item. The coding of an 
item in the assessment of a process was done with a plus 
(+) and minus (-) matrix system. A process received a 
plus if it was deemed necessary to complete a specific 
item. It received a minus if it was deemed unnecesary for 
a specific item. Problems arose, however, in the coding 
Oecd 2Lem tor a process. 


Each item required more than one process to complete 
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the item. In addition, some of the processes were neces- 
Sary fomsall) the) items on, all thesstated,: testsea, Someroe 
the processes were necessary for all the items of a 
specific test. Further, there was a general problem of 
definitions thatvmade analysis, difficult... The: problems 
were predicted by the background literature (Guilford, 
1960) 

It was previously suggested that the nature of the 
material in reading determines the quality of the intel- 
lectual abilities and the type of thinking abilities en- 
gaged. The types of thinking abilities were specific to 
thes tack, demands, of the tests. In: addition, there were 
general and selective processes specific to a certain test 
(Gui liord,»5.1960)>— Tf such premises ate correct, then the 
categories of general and selected processes as well as 
the definitions must come from the analysis of data. 

An example from one of the processes explains the 
difficulty in the ambiguity of the process definitions. 
Judgement was originally defined as the process of drawing 
conclusions by selecting and weighing the facts. The re- 
searcher struggled with the problem of whether the select- 
inegwand weighing of the Lacts came trom) the passage, the 
response mode, or both. In AdaULELOon ws Le CONC lust oOns 
drawn were Indicated in the form of alternatives in the 
response modes. Therefore, the reader was not necessarily 
drawing a conclusion but selecting one. The necessity to 


clarify the process of judgement as well as the other 
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processes became apparent. 

he initial item analysts forsprocesses revealed that 
the processes were reliant on the task demands of the 
tests. This analysis was used to arrive at very precise 
definitions of the processes in the nature of testing 
reading comprehension. The delineations of these defini- 
tions of the processes are described in Chapter IV as they 
result from the design of the study. 

The revised definitions of the processes were then 
applied to obtain the results from the score sheets in 
Appendix A. They were also applied to obtain the inter- 
judge reliability. 

The following section discusses how these results 


were analyzed. 


Results of the Analysis 


Tne results of the coding of Ltems for each test) to 
see if they assessed reading processes were put on score 
sheets found in Appendix A. From these score sheets, raw 
scores and percentage scores were calculated in Table 5-1. 

The raw scores were used to compare the number of 
items which assessed a specific process within and across 
tests. The percentage scores were calculated from the raw 
scores. They were obtained by dividing the number of items 
which assessed a specific process by the total number of 
items. The percentage scores were used to discuss the fre- 


quency of use of a particular process within and across 
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tests. 

The initial data analysis revealed that there were 
certain processes general to the nature of the testing. 
These processes were necessary to complete all the items 
in all the stated tests. Other processes were often found 
to be necessary to complete all the items on a specific 
test. Still other items were found to be necessary to 
complete only some of the items on any of the four chosen 
tests. The processes general to the nature of the testing 
were separated from the other processes called selected 
processes. The separation of the general and the selected 
processes was necessary since the results of the general 
processes within and across the tests revealed little in- 
formation on the assessment of the reading process other 
than the fact that they are necessary to complete each 
item of each of the stated tests. The results of the 
selected processes were, therefore, isolated. 

The results enabled the comparison of the frequency 
of use of the selected processes within and across tests. 
The comparison of the’ frequency of use of Gach of the 
selected processes was also compared to the averages of 
the sum of the percentages of selected processes in Table 
5-2. The comparison was valuable in assessing the fre- 
quency of use for a selected process to the average of the 
selected processes. 

The discussion of the frequency of use within and 


across tests for Tables 5-1 and 5-2 were done in separate 
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sections for each selected process. Reasons for obtaining 
a certain percentage score on a certain process are dis- 
cussed in the individual sections. 

The results of the score sheets found in Appendix A 
were used to determine the number of processes necessary 
to complete each item of each of the tests. These results 
are presented in Table 5-3. The information was used to 
assess the complexity of items to assess processes assuming 
that an increase in the number of processes necessary to 
complete an item increases the difficulty of that item to 


assess a single process. 


Reliability of the Analysis 


The reliability of analysis was established by com- 
paring the results of two outside judges, each completing a 
Master's degree in reading at the University of Alberta, 
with a third judge, the researcher of the study. Approxi- 
mately twenty percent of the items were selected for the 
inter-judge reliability by choosing every fourth item of 
each of the four standardized tests. Each item was 
analyzed, using the revised definitions of reading pro- 
cesses. 

The Arrington formula was then applied to determine 
the amount of agreement between the three judges. The 
following formula (Clarke, 1978) was the form used’ ain the 


study: 


2 x agreement 
2 x agreement + disagreement 
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The degree of agreement determined by the application of 


Lae AnrinelLon formulasis shown 1m lable: 3. le 


Tap lee gee 


Inter-Judge Agreement of Analysis 


Dis- Lota. Per- 
Agreement agreement Items centage 


Judges iand 2 424 56 480 .94 
Judges 1 and 3 Paliah 69 480 aoe 
Judges 2 and 3 0 has: 480 . 86 


The percentage of agreement was .86 to .94, 


Summary 


The data analysis of this study had revealed a need 
for more precise definitions of the reading processes as 
suggested by a review of the research. The delineation of 


these definitions follows in the next Chapter. 
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CHAPTER IV 
DELINEATION OF THE PROCESSES 


Data analysis of Chapter III showed the difficulty in 
delineating the processes involved in reading. Results of 
the initial analyses of the tests allowed the researcher to 
arrive at more workable definitions of the processes. The 
diiticuity of shesinitilal dérinitviens *wasetne™ inability to 
distinguish if and how a process was being used. Judgement 
was used as an example to show the difficulty in arriving 
at precise definitions of the processes. For the analysis 
definitions were needed that could not be interpreted or 
used in more than one way. 

Previous discussion on the model of the intellect 
(Guilford, 1960) suggests that there were also some pro- 
cesses that were present in most test situations. Since 
all the tests used in this study are reading comprehension 
tests, the researcher anticipated certain processes would 
bemeeneral to all™four 'stated casts. S*Another™ catezory sor 
selected processes was also anticipated. 

To arrive at the categories and the precise defini- 
tions, the researcher used the data from the initial 
analysis. Results of the analysis revealed that there were 


five processes common to each item of the four stated 
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tests. The initial percentage scores for these processes 
were 100 percent. These are the processes that will be 
referred to as general processes to the testing of read- 
ing comprehension in the four stated tests. The second 
category was the selective processes; that is, those pro- 
cesses necessary to complete only some of the items of the 
four stated tests. The selective processes are discussed 


following the next section on general processes. 


GENERAL PROCESSES INVOLVED IN READING TESTS 


Certain general processes were common to the four 
stated tests. These tests required the use of paper and 
pencil for the replies. This section proposes that the 
general processes are not only a product of reading com- 
prehension but of the format of paper and pencil stan- 
dardized tests in general. Similar format in other types 
of testing was used to show the comparison to the testing 
of reading comprehension. The testing of "Arithmetic 
Concepts" to "Paragraph Meaning" will be used as an 
example of how the general processes were a product of the 
format and the task demands of a particular standardized 
tests ‘The processes, referred to as general are; ‘fecog- 
Mition, association, judgement, phrase synthesis, and 
sentence synthesis. 

Since "Arithmetic Concepts" and ''Paragraph Meaning"! 
both come from the Stanford Achievement Tests, the format 


of the pencil and paper test is the same. Item 24 of the 
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“Artthmetie Concept’ states: 
24. 60% of 2150 is nearest --- 
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To arrive at the answer, the reader is required to recog- 
nize, associate, make a judgement, as well as synthesize 
information both at a phrase and a sentence level. Similar 
examplessirom Study oki tis & TSocral, studies . and 
"Science" show that these general processes become test 
phenomena of format rather than reading comprehension test 
phenomena. Some processes are inherent in the testing 
procedure while other processes are artifacts of the 
testing of reading comprehension. 

Although general processes became test phenomena due 
to the format of the tests, there was difficulty in the 
application of definitions for item analysis. There came a 
need to define the general processes very carefully since 
the general processes were being defined for testing in 
general rather than the testing of reading comprehension. 
Aplook at the reading of 2 book in comparison to, the read- 
Ine Of a test show the variance (Of neading tasks. While 
Toadine la DOOk wat eader 1 cmredulled tO interme are inter 
Mation within and across paragraphs. The reader can react 
the way he chooses to the writer's intended message. While 
Geadine a test, a reader must read a passage which=r1e- 
quires certain types of response modes. The way he reacts 


and interrelates information is governed by the type of 
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response mode and/or the question asked. The reader is 
being governed by the constraints of the test format. His 
reading of the reading test becomes an artifact of the 
testing procedure. It was, therefore, necessary to define 
the general processes in light of the reading task re- 
quired. 

Each of the following general processes was defined 
in terms of the test items from the Gates-MacGinitie Read- 
ins) Lests (survey E;ahorm.2M) 9° @hisstestswasi used since 
the other stated tests have long passages before the test 
items, so examples from these long passages would un- 
necessarily lengthen explanations. The general processes 
were, recognition, association, judgement, phrase syn- 


thesis, and sentence synthesis. 


Recognition 


Gray (1962) states that "'as meaning associations are 


W 


aroused, they are fused into a sequence of ideas 


" 


that the good reader ho] ds eine mamds were wnt), 
those that follow are recognized" (p. 19). Gray's state- 
ment suggests that the good reader holds in mind the mean- 
ine of thewiiret wordssunts | he recoenizes “those that 


follow. The following example: 


ie Skinned  vercewhoucoulmlo Veryecoid 
water may wear a rubber suit for 


ISS insilactonvestyle foode lubsaication® air 
A B C D E 


from the Gates-MacGinitie Reading Tests shows the reader 
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must recognize the meaning of the word "insulation" be- 
fore the meaning of the sentence is complete. The simul- 
taneous occurrence of other processes is acknowledged to 
make the meaning of the sentence clear. The necessity of 
the process of recognizing in dealing with the above item 
can be seen by the interrelation of the word "insulation" 
with the other words in context. Therefore, the process 
is obtaining the verbal meaning in context. 
Recognition is the process of obtain- 
ing the syntactic and semantic meaning 
iNecOncext. 
Association 
As the meaning of a word is recognized, the reader 
reacts thoughtfully to the ideas acquired by combining 
with past experience (Gray, 1960). To answer item number 
one of the Gates-MacGinitie Reading Tests, the good reader 
must have past experience or semantic-associational ex- 
pertence tor skin-diver', cold waten | rubber suit | 
ane e tis aceOln:. 
Items 32 to 34 of the same test also show examples of 
associating: 
The surface of the ocean bed can be 
mapped accurately and rapidly by using 
a modern sounding apparatus. Depth is 
measured by the length of time it takes 
oe —£O travel trom the surrace to 
the $8) of the ocean and to be 34 
back again. 


To answer item 32 with the word ''sound"”, the reader must 


have semantic-associational experience for "sounding", 
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"Ocean pedy. “depth 4) Vapparatue and. mappings “Similar 
semantic-associational experiences are needed to answer 
Leems jo and) 34. 
ASSOClLaAGloge  LReUNeL SP ehe Process oF 
combining past experience with the syn- 
tactic and semantic meaning of a word 
or words recognized. This definition 


acknowledges both the denotative and con- 
notative aspects of the association. 


Judgement 


Whether the test item is cloze multiple choice or 
multiple choice, the nature of the task demands on the 
reader determines the weighing and selecting of the facts 
presented in the passages to make a judgement or a decision 
as to what answer is the best choice from the alternatives 
given in a test item. Selecting from the alternatives is 
not identical with formulating one's own view. Formulating 
one's own view comes at a higher level of information 
processine (Gray, 1960" Staurter, 1969). §Gray eCL960) esuc= 
gests three requisites for evaluating what is read - 
selecting relevant standards, making judgements, and check- 
ing conclusions. The relevant standards used in completing 
items on these standardized tests would be to select one 
bese answer Outs On) 4a) pOSsible five? choices. = the vdecision 
has to be based upon selecting and weighing facts in the 
passage. An example follows: 

Tacitus was a great Roman historian who 


described the empire during the first 
century. He looked with disfavor upon 
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the exalted Roman emperors and 38 
them with sharp biting phrases. 


38. glorified governed ignored 


C 
criticized worshipped 
D 
A selecting and weighing of the facts - "disfavor", 
"described", and ''sharp biting phrases" - leads the good 


reader to choose "criticized" as the best answer for item 
number 38. By considering all the five choices, the good 
reader is also weighing the alternatives given by the test 
CONStrucroOnussand (checking his choice in, Jiehne of the our 
alternatives. 
Judgement is the process of selecting 

the best choice or answer from the 

alternatives given by selecting and 

weighing the facts in the passage and 


checkine that choice im light “of the 
alternatives. 


DYDENesSisou- Furase and Sentence 


Synthesis is the process which fits together infor- 
mation into a framework or unit of meaning. The recon- 
struction of this framework of meaning falls into two 
categories. The storing of information in memory is called 
iMpue aitormatton,| Lhe retrieval of untommation is called 
output information. Test formats demand output information. 
When a reader is asked to retrieve information, he uses 
Ewo processes, recall and recognition, Recognition implies 
Straisht association, with the printed stimuli or nonsense 
memorization (Smith, 1975). Recall implies both a number 


of associations and a synthesis of this information. 
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Recall is being tested but recognition is not in the format 
of the four stated tests. 

Severd points meed clariiteation in the last sen- 
tence) ine Gecogni tion process avsecussed in. thie «section 
is not to be confused with the general process of recog- 
DIELTON ep Lhe testing of recall aserestrictedsto the syn- 
thesis of information as determined by the response modes. 
The alternatives given in the response modes govern the 
number of associations and the synthesizing of these 
associations into a framework of meaning. Therefore, a 
restricted recall as being tested in these test formats. 

An examination of test formats reveals that stan- 
dardized tests require the interrelation of information 
into a framework of meaning. Whether the skill tested is 
speed and accuracy, arithmetic concepts, science, punctua- 
tion, or paragraph meaning, the reader is required to 
interrelate information into a framework of meaning. An 
examination of the test formats revealed that the reader 
is required to fuse information into a sequence of ideas 
at the phrase and sentence level. The fusing of ideas 
beyond the sentence level, or discourse synthesis, also 
eecticered. Since, discourse synthesisedid not loccurein 
every stest, (tele i will be discussed invehe ext ecection 
under ''selected processes'’. Synthesis at the phrase and 
sentence level become phenomena of test formats and, thus, 
general processes. An examination of the stated test for- 


mats led to a definition of synthesis that includes phrase 
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and sentence synthesis. 

In the format of silent reading tests to assess com- 
prehension, there are passages of at least one sentence 
in length. The fusion of meaning into a stream of related 
ideas must occur at the phrase and sentence level. Examin- 
ation of the test items reveals the fusion of meaning at 
both these levels. In the following items, 9 and 10, of 


the Gates-MacGinitie Reading Tests 


In the forest conservation program, 
land is often put under the 9 of 
trained foresters who make sure that 

LO cutting and replanting methods 
are used. 


9. rangers regiments supervisors 
work management 


10. proper uncritical undesirable 
forest censured 


the answers to item 9, "'management'"', and item 10, "proper", 
cannot be achieved by: associations and! fusing of infor- 
mation at the phrase level, e.g., "under the management", 
bUE Gabherm thesassoclatvons: andtinterrelating of intor-— 
mation from the whole sentence. The recall or synthesizing 
of information occurs in the stated tests at least at the 
sentence level so phrase and sentence synthesis become 
Beneraim processes aRecalll, inethe: above example, is 
restricted to the passagesstructure and the response modes. 

Variables which affect the recall of information be- 
Comesdmportantemns themtesting of necalie eNeyersn(lo/1) 
sibaede that: 


...passage structure alone (including 
relationships) 1s not thesonly tactor 


“Man genes OF tapes aptbba oe. squtte % 
waradiwa aa ena? 4 Yo esoueneteate Gree 
hesale= Ao mesYst 6 otnt poiosem co nnfast aa? pee eh 
-ehiea' lavel sofisansy Dus evening en 3a. TUBSe aaum webs 
8 Siinaat 39 notens ait oleawsy emul Tee? aitt BT] soles. 
%) O2-the 9 eretit sntvelie? ag nt .73a9el enett? dgod - 


2sed pushes. ois ian age a 
eee nolravw2s3G03'(GNSIC: ‘ere "2 7 
Ay <x. et) 125c: atte F nai; mI ¢? _ 
1443 ° es Oe "gol ey at erst ier As 


shedsan en itradddr Ore S34) 
2 : sie air da - 


_ 
7 
a7oa (Vasque be Maes eAsge 1 2 Ce : 
s 


TOS BAY ATO 


siddziesbny iepiabrons’ oe pas “th 


, 
7 
Levinas ~ Paeia 


“epgoeq" (04 mao bri , aesemgernam’ 0 mett oF alee ans 
~#8int 3o grlewt bis en>toelotuce ye Seveltdow a dommes _ 
'ereieeenes ats. wake" ,.9-3 /Isuel senide and a6 oe ljem 


’ , 
7 


“yotat Yo, abiduiortetn!\ bas .eroitnisgsan td Bede: 
poiuteaesaes vo fess; ofT .atteaasr phade ong aout 18m 
ON3-Ge 12451 fu 83282 bassie Silt std ‘etusee nol ametnt o 
eaonibd Sie alanve setaIdee: brn’ Seaydd oe 
ab elqeexe ovede edz at ,] favo 


50 


which determines the likelihood of units 
in the passage being recalled. The 
nature of the content occupying specific 
PpOSitrons in? the Wstuucture appears to 
have substantial effect on whether these 
items will be well or poorly recalled 


(pee oe 
lexGecnaLaccericti cs staskedemanus content, «and othe: 
factors have an effect on recall. Unfortunately, these 
variables are not accounted for in the stated tests. 
Straight memory recall is not measured in general. Rather 
only recall aaithestform Of associations and synthesis of 
information is amenable to measurement. The awareness of 
these variables and what can actually be measured led to 
the following definition of synthesis: 

SVIEnests Susiither process, of recall of 

a number of associations, as determined 

bytsyntactwcal structures .and “the re= 

construction Of these associations into 

a framework of meaning by the recognition 

of the best alternative of the response 

modes. ''Phrase'' and ''sentence" are 

words to describe the syntactical struc- 

tures and the number of associations. 

ihewdiscussion, in the mext section, on 

discourse synthesis will only deal with 


differentiating it from phrase and 
sentence synthesis. 


SELECTED PROCESSES LIN READING 
COMPREHENSION TESTS 


Selected processes of reading comprehension to silent 
GeAadimigucests arecdiscussed in this: section yeeln sthe 
initial sanalysiseprocessesi other than ethe genéralkepro- 
cesses were scored necessary to complete the items of the 


four tests. These processes were the selected processes 
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which have been suggested as common by the literature but 
which may not be found in every test item. 

The definitions of the processes derived from the 
literature were not precise enough for the initial data 
analysis. Therefore, the initial anlaysis was used to re- 
define the selected processes. The redefinitions of the 
selected processes appear in the following order: 

- prediction 
- inference 
- classification 
- comparison 
- generalization 
Ga) induction 
(b) deduction 
- sequencing 
- restatement 
- discourse synthesis 
The processes are listed in this order not because of pri- 


ority but because this was their chronological order for 


the selected processes on the researcher's score sheets. 
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Srien LU ob) Savs"that a sreader tc apie to predice 
what a writer is about to say because the reader is able 
boereduce=uncertaintyein all aspects"or his *perception of 
the world and because the reader has the prior linguistic 
Knowledee of how the’ writer is likely to express his in- 
tentions in surface structure. The reader uses knowledge 
of the world (semantics) and knowledge of language (syntax) 
to predict or anticipate what may happen in connected dis- 
Course, The application, of prior knowledge to the printed 


stimuli by the reader in his endeavor to anticipate meaning 
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as) called prediction. “Through nis expectations the reader 
samples the surface structure, syntactically and seman- 
tically, looking for limited matches of correspondence. 
The reader is then bringing a limited set of alternative 
meanings to the surface structure. From this he uses his 
knowledge of the world (meaning) and knowledge of language 
(morphology and syntax) to process the writer's intended 
message, 

The process of prediction changes in the test format 
task compared to a reading of a book task. For example, 
in the reading of a book or a passage, the reader can pre- 
dict the likely alternatives of the next word or few words 
if the reader knows where the writer is headed. As these 
expectations are confirmed or unconfirmed, the reader 
modifies expectations of words to follow. Thus, in the 
sentence ''The captain told the mate to drop the 
the reader would have certain expectations of the word to 
eo into she blank.) By the syntactic eonstLnuction on the 
sentence, ‘the reader can predict that a noun will follow 
Bhevdeterminer. “the! s the words, Captain’, 2mate’ f7and 
mdcOo!, (wellSsive cerntain=semantice clés yior \predi Culon by 
the “reader. “If ‘the reader predicts the word “anchor”, he 
need tonly cue in conta few lot the features of the word to 
eontirm on denyethewpréedi ctions  \Préedvetionyeds ih 1s ex- 
plained in thé above isnot uséd*as avderinition in this 
study. 


Inm-thesreadinenor thaeisilent reading, tests, the 
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reader is required to read passages varying in length and 
response modes. The response mode of cloze multiple choice 
allowed the reader to predict or anticipate what word may 
besused to fill in the blank. The reader brings a lamited 
set of alternative meanings to the surface structure. The 
reader must interrelate the information up to the point 
where the blank occurs and not require the information be- 
yond the blank to arrive at the anticipated answer. The 
reader then goes to the answers to check his expectations 
and eliminate the alternatives. An example of prediction 
from the Gates-MacGinitie Reading Tests shows the type of 
prediction processing that can be assessed in the four 
stated tests: 
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Piesaistince1On in. vie spLOCescilnewiclLin tly LLOtepi.e — 
diction was necessary since it is not possible to analyze 
when the reader is predicting in continuous discourse. It 
became necessary, therefore, to define precisely prediction 
SOmtHat 1 was esDeCi111c gto uLhe testing (Or ureading fon silent 
reading comprehension tests. 

The process of prediction, as used in 
this study, is the comprehension of the 
test constructor's literal message be- 
fore the cloze blank but goes beyond the 


information given to predict the content 
and the way the test constructor will 
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presents Ltye, lhe 1nLocmation aAbter the 

cloze blank and the answers given only 

go to confirm or reject the anticipated 

answer. 
Inference 

According to Furniss (1978) inferencing is: 

ws.the ability by the reader to: inter- 

pret.what. the writer hasesaid ina 

current sentence, or to predict future 

text sentences by relating current text 

information to earlier text information, 

prior knowledge, and task demands while 

reading (p.. 24)- 
The amount of text information interrelated is dependent 
upon the characteristics and task demands (Thorndyke, 
o/ >) elie wteackedemandsuor thes toumestandaraized silent 
reading tests require that the reader recognize the in- 
ference that was generated by the test constructor. The 
appropriateness of Furniss’ definition can be seen by 
examining McLeod's definition of inference (McLeod, 1978) 
which is the "cognitively generated information based on 
explicle linewistic and Don-lianguicstic  imeormacionspro— 
vided in the context Of. continuous written discourse and 
which was previously unstated” (p. 19). 

Since the answers are already given, the reader is 
mot 'cosnitively generating inrormation but merely 
recognizing the inferences generated by the test construc- 
tore Iheretore. Mcleod’ s definition Cannot apply to ithe 
four statedi tests. Instead of “unstated” information, the 


test format provides alternative answers which dictate the 


type of information interrelated to arrive at the best 
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choice or answer. Furniss’ definition provides.less re- 
SLE LCULONS#inedeveloping a definition for this study. 

Several factors have to be considered in formulating 
aecetini t1On ,obMinferencing, ~Certain passages of the 
reading tests are not continuous written discourse so the 
process of inferencing would be sensitive to the text 
ehavacteristics of whe test passaces ((Thorndyke, 19/5). 
eemorestlexiblesderinition of textecharacteristies «that 
includes relating information from a word to a passage 
Fevolsismprovidedminse Furniss.) definition. In addition, 1t 
states the diversity of definitions for inferencing 
(hvinice. Lo) Oo )easewellvas, thescomplexity of the process 
Of imeerencing, (lcheod, 19738) Furniss, 19/73)... A complete 
study on the nature of standardized tests to assess in- 
ferencing would be required to discuss the multi-facets of 
the process. This study will confine the analysis of in- 
ferencing to a global definition since the complexity of 
the process of inferencing was not well published at the 
time Of the construction of the stated silent reading 
tests. 

The global nature of the definition of inferencing, 
together with task demands and text characteristics, pro- 
duced the following definition of inferencing to be used 


ite this Study. 


Inferencing is the process of recog- 
nizinge inethe response: modesthe inter - 
pretation Of information generated: by 
thestese constructors, byarelating.current 
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CexG information eObrGenes bese 6t Osea! 1 er 
text information, prior knowledge, and 
task demands. 


The previous example from the Gates-MacGinitie Reading 
lesteexhibits the process of inferencine: 


Skin divers who go into very cold 


water may wear a rubber suit for dab te 
ibAmainsulagiongestylewstood es. lupinicai on 
A B C D 


The test item requires the relating of text information, 
current and earlier, to prior knowledge using the task 


demands of cloze-multiple choice. 


Classification 
Barrett's Taxonomy of the Cognitive and Affective 
Dimensions of Reading place classifying under reorganiza- 
tion. Reorganization requires the student to analyze, 
synthesize, and/or organize ideas or information explicitly 
stated in a passage. These actions upon the ideas or 
information require classifying to place people, things, 
places, and/or events into categories. Therefore, a 
student must identify and match more than one component 
andsecoup by ;commonality. slhe wollewingsexcerpe © 1tem) 50, 
of the Gates-MacGinitie Reading Tests, serves as an ex- 
planation sample: 
The Texas Rangers are respected as 

brave and effective fighting men. Sam 

Houston preferred Rangers to regular 50 

as defenders of the Texas borders because 


Obgtnelmaspectal sLroneler  bnuaining, 


The answer "troops" matches with the component ''fighting 
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men". The analysis and -organtzation of other information 
such as "regular" or "defender" allows for the reorganiza- 


(Ione anceoynthesiSsor intormatlonstOo arrive atethercorrect 


answer. 

Classifying, then, is the process of 
reorganizing and synthesizing information 
to identify or match in the response mode 
more than one component of an idea or 
information into a category. 

Comparison 


According to Gray (1960) the good reader uses com- 
parison as a process to "anticipate and follow the author's 
ideas, noting their arrangement and sequence, important 
relationships among them, and the meanings implied by 
antecedants and referants" (p.13). Gray's statement im- 
plies the use of other processes as well as comparison 
but he acknowledges this when he states that "many mental 
processes are involved in fusing the new and the old such 
aseonalysis,, comparison..." (p.19).) Therefore, com- 
Parison is a process that helps in the fusing of new and 
old information by analyzing and matching information by 
lining up the differences in the information. 

The process of comparison had to be defined precisely 
since it was not possible to test the reader's use of com- 
parison as he was reading the passage except with the 
response modes of cloze multiple choice and multiple 
choice. It was necessary to delineate the process in terms 


of task demands of the silent reading test. The example 
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that follows from the Gates-MacGinitie Reading Tests was 


used to arrive at the definition of comparing for this 
etudy: 
Selective breeding is the attempt 
to develop the best possible plants and 
animals. Scientists have worked to 
5 the most desirable features into 
a single ie 


15. sell combine deny use declare 
DOSeestrain bactlem day snoise color 


Since there is not enough information to answer the blanks 
without looking at the alternatives, the reader must use 
the process of comparison and line up the differences to 


imi 


abuiviewac ethe "correct answers or = combine’! vand™ strain’ 
respectively. The process of comparison in this study is 
dependent upon the response modes. 
Comparison, then, is the process of 
analyzing and matching the features of 
the response modes with the passage in- 
formation and lining up the differences 
in features to arrive at an answer. 
Generalization 
In Gray's (1960) fourth aspect of reading, he states 
that many mental processes are involved in fusing ideas ac- 
quired through reading with previous experience - "inherent 
in comprehension, critical evaluation, and assimilation is 
a otal niyeon mind athe tenacmbeen Gecenily calledscreative 
Svineine MC ome COnCInUI ney Wemadicwn Meet yo lvese the 
imaginative treatment of ideas in both inductive and deduc- 


tive thinking and results in new insights, fresh ideas, and 


new organi zationswor wpatterns tort ‘thoughts’ \(py sto) 29 When 


eod40 af? ai, geibesa ev li29ia& 


inh BJecimeldigeon 3057 Bus geipveb a2 
oy bawrew avid cfaiiirioe | # 


6gng Berns) s/n ltisk asd ed3 


sieteeh cow vash aobtmad lise ier 
salah @ile% vob witged 'fiaswe ei 


eunnid see wan7enh ©'1 yc dramas lee davoas vor ai ated 


eb feuq sabney 4¢* ‘esvriairmtle ees ve gfaieod 


a3 Benreeiiip. sofa mu sal! oan ngeisegwoy To SFeeezg ame 


Netewsgh" “bad. ishinvnes' In etawann ‘tagvse9 52 36 av. . x2 


2S yOuFa 21H 1s Nes T6OTHo he. ss45otm sel imei 
sigtha Senor att nec 


tn dnapoun bus aims aerremgped 

T83 5%* Lin Ar AALOI Hep sc tsvtecm if 

2 watoerq srs daiw.ssbel sadogeas ony 

fee. se ae ent qu sslilal Dep Agta 
Savsht As 19 4virva of Bevoseg: a2 


| ay 
ie ee ae SS 


_= 


goveds en stithass Yor doers) fro?) (O88) ew yeme ar 
ess shabfadieji «a: er e356 e32e007g leodam oan 3 

snazedint" - sacl aaGxe sheen ch gaikesy Agi st. 
Bal alin bite pigetitave fees : 
-~ feito maa aud quate 


f Ss wilh 7 ie & phe ous i: jor si 
SP. ; aw eine oe 

7 - enh. : au ik S*y sf on eed vt d 3 5 > ‘ bey 7) 

ee > , 

> ; 4 a 


> 
Tae 


aye 


Thesinductive o1 deductive thinking activates: pattertis of 
thought which recognize the similarities between two or 
more components, the mental process is called generalizing. 

Piaget (1966) describes the development of general- 
Lging in awehi ldawhen he ws: 

...no longer content to explain one 

phenomenon by another simply by re- 

calling their common history; he wants 

to connect the two phenomena by a 

necessary relation. Transductive 

reasoning yields before the increasing 

need for combined induction and deduc- 

tion. Generalization has become pos- 

Selden T@ce ashe eia 
It is necessary in defining generalization to define in- 
duction and deduction. Induction is the process of reason- 
ing from partieular facts toyform a,general iconelusion. 
Deduction is the process of reasoning from a general con- 
clusion to specific facts. Both demand a necessary rela- 
tion between the two phenomena. 

The delineation of generalization, induction, or 
deduction in the present study encounters the same problem 
as other processes. Neither the inductive or deductive 
generalizations formed were generated by the reader but 
recognized as generated by the test constructors. The 
mecessity Ot «defining, a process in’ terms, of the task) de- 
mands of the tests became necessary. 

An example of generalization was found in item 1 of 


thesGates-MacGinitie, Reading Tests: 


Skin)divers who go into very cold 
water may wear rubber suits for insulation. 
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messentencemrequires! the relation of “skin divers Ucold 
Wabetiem abd irubberpsuits! Torinductively arrives ateche 
answer "insulation"’. An example of deductive generalization 
would be item 5 of the same test: 
Boll weevils are beetles that lived 

Principally eonewihld=plants until copten 

was introduced to the south. 
The reader*moves from a) general’ conclusion, / "wild plants”, 
EOra Sspeclmremractce. cottons. 

Both examples show the necessity of recognizing the 
Similarities between two or more components. They also 
show the reliance of the generalization on the answers in 
the response mode. Therefore: 

Generalizing is the process of recog- 
nizing the similarities between two or 
more components in the test passages and 
response modes to arrive at an inductive 
or deductive answer. Induction and deduc- 


tion are used as sub-categories of 
generalization in this study. 


Sequencing 


Gray's (1960) major aspects of reading explained how 
meaning associations are aroused or fused into a sequencing 
Ofsideas.. Bilis Lusinesoccurs inecomprenensiong) ghe states 
that "as the meanings of a passage unfold the good reader 
eiieteipaves and, LOulows the autnoOr Seldeas snoGing. taer 
arrangement and sequence” (p. 13). ‘Therefore, sequencing 
detemminesstherorder;that thesideas:omintormation ane 
received in a passage. 
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a fusing of meanings into a stream of ideas at least at the 
sentence level, sequencing for this study includes only the 


fusing of ideas beyond the sentence level. The following 


examples from the Gates-MacGinitie Reading Tests will serve 


as an example of sequencing: 


The number sentence 2 + 8 = 8+ 2 is 
an instance of the commutative prin- 
Ciple lob addition mas Lhs 41 describes 
a property of the number system. The 
Principle 7s. sthe 42 in which we add 
two numbers has no 4.3 on the sum. 


ine aticwers “principle, (4i). “order #@2)e. and “etrect 
(43) require the processing of sequencing to fuse the mean- 
ings into 42 stream of ideas. 
For this study, sequencing is the 
process of fusing meanings into a stream 


of ideas which are ordered beyond the 
sentence level. 


Restatement 
Restatement is the process of recognizing that one is 


restating what has been said. An example from the Gates- 


MacGinitie Reading Tests explicates this process. 


The mountain people of Lapland wander 
south in the winter. In summer they 
gO NOrtLh LO pastune theim herds orsrein— 
deer. While there, they make cheese to 
take 5 with them when the cold 
weather comes. 


Ou eOuth north cold “heal from 


A B C D E 
The best answer, ''south'', is a restatement of what has been 
said in previous sentences. The response is a combination 


of information from the passage and the best alternative 
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from the response mode. In this study: 
me Lestarine, 1S the pLocess Of 1 ecogii zing 
that the best alternative from the response 


mode is repeating what has been previously 
stated in the passage. 


Discourse Synthesis 
A previous section on general processes has defined 
Svntnests. Depending om thessyntactteals structures, there 
are several types of synthesis. Phrase and sentence syn- 
thesis have been previously defined. Discourse synthesis 
contains more than one sentence. 
Discourse synthesis was the type of synthesis deemed 
MOE to be general to the nature of testing. Jt was thus 
classified as a selected process. Discourse synthesis 
uses the same definition of synthesis as phrase and sen- 
tence syntnesis; Lt*obtained its ditterent classitication 
from the general process by requiring the interrelation of 
information beyond a sentence level. Discourse synthesis 
is defined as: 
the process iot “recallhor a number of 
associations beyond the sentence level 
and the reconstruction of these associa- 
tions into a framework of meaning by the 


recognition of the best alternatives of 
the response modes. 


SUMMARY 


The delineation of the reading comprehension processes 
revealed two categories of processes - general and selected 
processes. The revised definitions of the general processes 


and the selected processes were constructed to accommodate 
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the nature of testing and the nature of testing reading 


comprehension. 


The definitions of the general processes are as fol- 


lows: 


Recognizing - 


Associating - 


Judging - 


Synthesis - 


the process of obtaining the syntactic 


and semantic meaning in context. 


the process of combining past ex- 
perience with the verbal meaning of 


a word or words recognized. 


the process of selecting the best 
choice or answer from the alternatives 
given by selecting and weighing the 
facts in the passage and checking 

that choice in Wight of the alrer— 


natives. 


the process of recall of a number of 
associations, as determined by the 
syntactical structure, and the recon- 
STIUCEION Of these associations into 
a framework of meaning by the recog- 
nition of the best alternative in the 
response mode. 


vat 


"Phrase'' and ''sentence" are terms used 
tO,Gdescripesthe syntactical ystructures 
relative to the synthesis in the 


general processes. 


The following are thesderinitions -OLVEnecEsevecteds processes: 


Prediction - the process of comprehending the test 


constructor's literal message before 
the cloze blank but going beyond the 
Intormaclon SLVven CO predict. toce content 


and the way the test constructor will 
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Dresene 1 t: 


Inference - the process of recognizing in the 
response mode the interpretation of 
information generated by the text 
CONSEGUCLOM by relating current, text 
iNntOrmatLon of stne tests to earlier 
text information, prior knowledge, 


and task demands. 


Classification - the process of reorganizing and 
Synthéesizing intormation to identify 
or match in the response mode more 
than one component of an idea or in- 


formation into a category. 


Comparison - the process of analyzing and matching 
the features of the response modes 
with the passage information and lining 
up the differences in features to 


arrive al ane answer. 


Generalization - the process of recognizing the 
similarities between two or more com- 
ponents in the test passages and 
response modes to arrive at an induc- 
tive or deductive answer. Induction 
is the process of reasoning from par- 
tieular facts tomtorm a seneral con— 
clusion. Deduction is the process of 
reasoning from a general conclusion to 


specific facts. 


Sequencing - the process of fusing meanings into a 
stream of ideas beyond the sentence 


level. 


Restatement - the process of recognizing that the 


best alternative from the response mode 
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65 
is repeating what has been previously stated in 


the passage. 


Discourse synthesis -sthe plocess of “synthesis using 
syntactical structures beyond the sentence 


Tevals 


The following Chapter will discuss the analyses and 


tindines, Of the study. 
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CHAPTER V 


THE ANALYSES AND FINDINGS 
OVee bo Pago auen 
Fifteen processes were redefined and used to analyze 
each item of the selected tests for general and selected 
processes. Table 5-l gives the raw and percentage scores 
of the processes required to complete each item of the 
four tests. These results reveal the existence of general 


and selected processes for the given test formats. 


GENERAL PROCESSES 


Chapters) [LI and WV discussed ithe existence of céer= 
tain general processes which are the product of the test 
formats. Table 5-1 confirms that the following processes - 
ecogntcion, association, judgement, phrase synthesis and 
sentence synthesis - are processes general to the stated 
tests —wexamination of tthewsections of the tests other 
than reading comprehension reveal that these processes are 
aleo present in these sections. ‘Chapter [il provides 
background literature which stated that there are some 
processes general to the nature of testing (Guilford, 1960). 
Table 5-1 provides the information as to which processes 
are general in these tests. The processes may vary accord- 


ing to content, product and operations (Guanrord , 1960). 
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For the four tests analyzed the general processes of recog- 
nition, association, judgement, phrase synthesis and sen- 
tence synthesis are processes general to the nature of the 
tests and, thus, become test phenomena. These general 
processes address themselves to the question - will any 
test which involves reading include these processes? 

The data from the four stated tests suggests that 
five general processes stated above may, in fact, be 
phenomena of test formats in general which are required to 
De read. Verification could be determined in future 
studies. 

Some of the processes, other than the stated general 
processes, received scores of 100 percent on some of the 
tests. These processes did not score 100 percent in all 
the stated tests. They could not be classified, then, as 
general processes. Each of these selected processes are 
to be discussed in the following section on selected pro- 
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ANALYSES OF SELECTED PROCESSES 


This section deals with the comparison of selected 
Processes Witiin and across tests: Percentages were used 
to discuss the frequency of use of selected processes. 
Percentages were used to make the comparison since each 
test contained a difference in the total number of items. 
The percentages revealed the extent to which a process 


was being assessed. An inter-test comparison of the 
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selected processes was possible from the data. Table 5-1 
provides the raw and percentage scores of each process. 
Table 5-2 represents the averages of the sum of the 
percentages for selected processes. The average is ob- 
Eaamed by dividing the tCotalmom ene percentages of ithe 
selected processes for each test by the number of selected 
processes, 4. The table is used to make comparisons be- 
tween a single selected process and all the selected pro- 
cesses in frequency of use” The table is also used to 
make a comparison of the averages of the frequency of use 
of the selected processes across the four tests. Table 5-2 
reveals that each of the four tests are close in the 
averages of the frequency of use of the selected processes. 
tnsotner words, this table tells thatethe four tests were 
approximately equal in the average assessment of all the 
selected processes. This would suggest that not one of 
the tests examined was superior to the others in the 
assessment of selected reading-thinking processes. By 
comparing a single selected process, snowever the re- 
searcher was able to determine the extent to which a pro- 
cess was assessed. For example, the selected process of 
Classiiication was tound’ to be present in 1353 percent of 
the test items on the Stanford Achievement Test. This is 
Sieniticantly below the average of the selected processes 
assessed in any of the four tests. Similar comparisons 


can be made with all the other selected processes within 


and across tests. 


” dination iin bee patuse ospdeseieq 
ede 30 ave os. th edgexeve ofa wdaweezges | 

> Nd @guitave SOT .seebuon2q beaspier 2et mage 
aly 2 esgarheodec bd} Yo pesor els no ieeuphs. yo, beatae 
bavdaleas 36 sadmae 61 vd te02 done tok seanovery Setoeles : 
{46 evowFunaties Siac o: bese ct- sideavedTt 0.8, @peannomy 
eoaq szobles alla Its brs szoonmn. beaselar elgude » aoqus : 
od beew dels 25 ofc act ‘abu ty voneyuerd at aseeso : 
yes 2h vaweops;? er: ° Pare re of? 26 soe 2egm@es & salam ? 
CoB -giday ase 4c ade 42507%¢9 ‘anens0e3e Gezonias ana, to 
ahtsei deals ate. #24 mie? 262 Jp Aces Jae alsovst 
SSERSICTH. HOIUSi62 95, 20 S20 <P iapou peo 2 3a to. aeqereys 
gusy cises wu? ati sarc elisa ae eit abtow seize at 
o03.4in 16 1Imurepenes see 2ere ors ni lema~s Tosamtnorqga 7 
So ane. son 1aty Saeague biuow -2idi - conaeaaeg, batoelee) 
Sg 2 2ySilict whi’a” Je laeues, giv Laniaaee efaad a0 


vi aseeecots gn )ei*de-Sarltee Sataniog 26 


“6% Sflo .. vevaem ~sésunid Sstonles.slgete 6. 


-wey «2 Siidw of mnetvo ody owtetragoh of elle eae 


to eeepeng Seipeioe oh" Sk Guen ee bonnenae enn a 
Peneras ths) sostedo dias Shock sew anditugte 


7 Us 
e2. wate A Fae BU US 9") 1a i BLL IIN Pe : outa > 

7. Ore - 
. sacs _ . 


* 


70 


Table 5-2 


Averages of the Sum of the Percentages of Selected 
Processes for each of the 
Silent Reading Tests. 


Gates- 
Metropolitan MacGinitie StanLlorcd GIBS 


Average 54.2 43.3 Sy Si) 54.2 


the, following. sectionsawill andividually, discuss. each 
of the selected processes. They will be discussed in the 
order they appear in Table 5-1. Constant reference to 


Tables 5-1 and 5-2 will be necessary. 


Prediction 

Using the definition derived from this study the 
process of prediction was found not to be assessed by the 
Metropolitan Achievement Tests and the Canadian Tests of 
Basic okills, Both tests contain the response of multiple 
choice. This response mode does not assess prediction as 
iijeLcuacerined in this “study. "in the above tests, a passace 
is read and then the reader is asked to answer certain 
multiple choice questions. Since the reader does not know 
what information the response modes are requesting, he 
cannot confirm or check expectations by his knowledge of 
syntax and knowledge of the world. Rather, he must examine 
a igseche alternatives. ands tbhnrouch the, process, og comparison 
and judgement of the stated material, arrive at an answer. 


Prediction did not appear to be specifically tested in the 
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above tests. 

Since prediction was not specifically tested in the 
above tests, the process becomes a phenomenon of the 
response mode of these tests, multiple choice. The process 
is a phenomenon of multiple choice in that the response 
mode,deesmot usually assessuprediectionpas LEeisaderined in 
Enigestuday. 

The other two tests did assess the process of predic- 
tion. The definitions in Chapter 1V provide examples of 
the process and the response modes. Table 5-1 records the 
pencentage escornes at. OL 9sfor the Gates-MacGinitie Reading 
Hest uand.5).0 for sthe Stanford Achtevementelest: = The 
scores indicate that the frequency of use on the two tests 
(Table 5-1) was similar to the frequency of use of all the 
selected processes (Table 5-2). The results suggest that 
the two tests assess prediction with a frequency of use 
similar to the average frequency of use of all the selected 


processes. 


Inference 

The process of inferencing was found to be redun- 
dantly scored on the tests requiring the response mode of 
eloze multiple chovee, Only the Gatec-MacGinitie Reading 
Tests and the Stanford Achievement Tests require this 
response mode. Since this response mode requires 
filling in the blanks within a passage, then a reader is 


required "to interpret what the writer has said . . . or to 
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predict future text sentences by relating current text 
information to earlier text information, prior knowledge, 
and task demands while reading'"' (Furniss, 1978). The task 
demand of cloze multiple choice requires passage infor- 
mation of at least a sentence in length to generate a 
response from the alternatives given, thus inferencing is 
inevitable. 

Tne Treader is required to recognize a given inference 
by interrelating stated information with prior knowledge. 
The reader is not necessarily generating his own inference 
but recognizing an inference generated by the test con- 
structors. Inference, then, becomes a phenomenon of the 
response mode of cloze multiple choice. 

Inferencing was found to be necessary in all items of 
the Metropolitan Achievement Tests and the majority of the 
CanaGdianielests On basSvc sk islomy 6.64). = hestactetnar both 
these tests did not require the process of inferencing in 
all their items suggests that inferencing is not a pheno- 
menon of the response mode, multiple choice. The re- 
searcher could only speculate that the questions asked in 
the Metropolitan Achievement Tests made it necessary to 
use inferencing to answer each question. In addition, the 
Eype Of passage could account fOr a high=percentave: score 
of the process. The questions asked, however, appear to be 
tie: Dasic difference in) the’ percentages: 

A comparison of the percentage scores for inferencing 


with the average percentage scores for selected processes 
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in Table 5-1 suggests that the frequency of use of in- 
ferencing is above the average frequency for each of the 


four tests (see Table 5-2). 


Classification 

Table 5-1 reports the frequency of use of classi- 
Encation™ as ranging trom 6,/ to1a9.74. These results Suc- 
PestauivacetEhe irequency Of usc son (classi ol cation, us) Less 
than the frequency of use of all the selected processes. 
The results do not suggest necessarily that classification 
is inadequately tested but that the frequency of use in 
the four tests is less than the majority of the other pro- 
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Comparison 


The process of comparison was used in all items of 
the Metropolitan Achievement Tests and the Canadian Tests 
of Basic Skills. In these tests the test items demanded a 
response mode of multiple choice. The task demands re- 
quire the process Of judging to weigh and” select infor 
mation. In addition, the reader is required to compare the 
alternatives given in the response mode. The task demands, 
then, are the same as the process of comparison described 
tr ehapter LV, that is, atalyzing and matching the teacures 
of the response mode with the passage of information. 
Comparison thus becomes another phenomenon of the response 
Mmoce of multiple choice: 


The response mode, cloze multiple choice, does not 
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always require the process of comparison. The reader is 
able to make judgements of the best choice without looking 
necessarily at all the alternatives in the response mode. 
The response mode of cloze-multiple choice is found in the 
Gates-MacGinitie Reading Test and the Stanford Achievement 
mhecue Unese tests assessed comparison in 590.0 and 88.3 
percent of their items respectively. 

A comparison of these results with the average per- 
centage scores for selected processes indicate the Gates- 
MacCinitie Reading (Testsis simi lamvand tne stantord 
Achievement Test is above average in frequency of use of 


the process of comparison. 


Generalization 

The range for the frequency of use for the process of 
Peneralization is 62.2 to /0.0- “in addition. ‘the Table. 5-1 
reveals the range for the sub-headings of generalization 
to be bo 2 to 44.4 for induction anc=/-o-co- 44. J =for-de- 
duction. The scores for the process of generalization show 
a copeistency across the four tests. in addieion,» the 
frequency of use within each test is above the average for 
the selected processes. The difference in the scores 
comes in the analysis of the sub-headings of generaliza- 
ELOn. 

The sub-headings of induction and deduction reveal 
thae three of the four tests are mot similar in their 


assessment of induction or deduction. The respective 
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Scores Or induction. and deduction, are 44.4. and 1/26 on 
the Metropolitan Achievement Tests, 19.2 and 44.3 on the 
Gates MacGinitie Reading Test, 933.3 and 36.7 on the 
Stanford Achievement Test, and 41.4 and 25.6 on the Cana- 
dian Tests of Basic Skills. The Metropolitan Achievement 
Tests and the Canadian Tests of Basic Skills almost double 
the frequency of use of induction over deduction. The 
Gates-MacGinitie Reading Tests double the use of deduction 
over induction. Only the Stanford Achievement Test was 
similar in the frequency of use of induction and deduction. 
Such information is useful in determining which tests may 


be used to assess the sub-headings of generalization. 


Sequencing 


The process of sequencing was above the average fre- 
quency of use for selected processes. The percentage 
ScOmese Lame romeo ss) 1eO Oo. 

The lowest score was on the Gates-MacGinitie Reading 
hestseand suggests that the lenpthfot the test passages, 
usually one to three sentences effects the frequency of use 
of sequencing. The other three tests with longer passages 
and a @reater number of sentences require a higher fre- 
quency of use of the process. Since sequencing is defined 
ine this study das the fusing of medning beyond the sentence 
level enesimolicaticom ico tiatchesELequency OLMusc LOL 


sequencing is greatly influenced by the length of the 


passage. 
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Restatement 

The percentage scores for the process of restatement 
have the greatest discrepancy in’ the frequency of use. The 
Scores oancer (oom l9N2 COn/ lt percenc. Three of the four 
tests are below the average frequency of use for selected 
processes for their respective tests. No reason is given 
for the discrepancy other than to suppose that the test 
CONSUrUCEOrS Of all the tests "other than the Stantord 
Achievement Test did not want the answers to be restate- 
ments of the original passage so as to produce high test 
scores. The Stanford Achievement Test is the only test 
with a high frequency of use. 

The task demands of the four tests seemed to influ- 
ence the frequency of use. The two lowest scores mainly 
employed cloze multiple choice in their tests. The two 
highest use multiple choice. The task demands of cloze 
multiple choice do not lend themselves to restatement of 
passage material with one word responses. Multiple choice 
@an more weadily offer phrases on sentences that are re- 


statements of the passages. 


Discourse Synthesis 

Discourse synthesis was separated from the general 
processes of phrase and sentence synthesis by definition. 
Tables 5-2 and 5-2 reveal that discourse synthesis has a 
high frequency of use when compared to the average fre- 


quency of use for the selected processes in each test. The 
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percentaretscores for sdiscourse isynthesis range from 63.5 
to 85.0. Although the process has a high frequency of use, 
it cannot be considered a general process as not all items 


require the process. 


SUMMARY OF THE ANALYSIS OF 
DELECTED PROCESSES 


The previous discussion on each of the selected pro- 
cesses has revealed that certain tests assess more effec- 
ELvely certain processes, “In addition, the results of 
Table=5-l reveal that it is impossible to tso0late the 
general processes from any of the four stated tests. 
Therefore, these processes are global in nature and can 
only be assessed in gross terms. 

The percentage scores for the selected processes 
were compared to the average percentage scores for all 
selected processes to analyze the difference in the fre- 
quency of use of the processes within and across tests. 

The general processes were not considered in the comparison 
of the frequency of use since these processes were found to 
be common to each test and global in the nature of testing. 

the diseusssonsot sche testeresulessoh (centeain 

selected processes revealed that they were test phenomena 
of their response modes. The response mode of multiple 
choice demands the use of comparison but not the use of 
prediction. Inference becomes a test phenomenon of the 


response mode of cloze-multiple choice. 
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in addition, classification is not extensively 
assessed by all four tests. Restatement is not extensively 
assessed on three of the tests. Only the Stanford Achieve- 
ment Test equally assesses induction and deduction, the 
sub-headings of generalization. Sequencing and discourse 
synthesis necessitate each other as they are now defined 
Since they obtained equal percentage scores. 

The table results indicate that the average per- 
centage of frequency of use of all the selected processes 
is similar, within 10 percentage points. Table 5-1, how- 
ever, reveals variation in the percentage of individual 
selected processes. The difference indicates a variety of 
processes deemed to be inherent in reading comprehension 


as assessed by these tests. 


CATEGORIZATION OF ITEMS ACCORDING 
TO PROCESSES 


The sum of the within items across processes results 
aber presented an Table 5-3. elhe results reveal sEnae More 
than one process is involved in each item. The table in- 
aqucaces the number Of processes, OU Of al total, of fourteen 
processes, necessary to complete each item of the four 
stated tests. The total number include the five general 
processes. The inclusion of the general processes provide 
little information except to show the process complexity 
of each test item. The total number of selected processes 


can be obtained by subtracting the five general processes 
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Table 5-3 


Number Jor Processes, out,-oG 2 [otal sof Fitteen 
Processes, Necessary to Complete each Item 


of the Metropolitan Achievement Test, 


Gates-MacGinitie Reading Test, 
Stanford Achievement Test, 


and Canaqcianiuests OF 
Basie okKmLius 


Items* TeSES 
Gates- 
Metropolitan MacGinitie SEAanroOrd Gali anor 

J (eZ 10 12 a2 
2 9 ie, ile 
3 EZ LZ ihe 
4 2 diag i We 
) Ae. 10 9 he? 
6 12 LAL ab aba 
vi 8 9 12 ink 
8 GPs §) IEE 12 
9 PZ 8 10 ) 
a6) iL 7 eZ 12 
TE Lt 5 aly te 
eZ ) Me 2 iT 
is 10 le 10 10 
14 8 aS 10 Ln 
Ws) 10 inv 9 12 
16 IP ez 9 ie 
by 8 10 ie iil 
18 a Ah i3 eZ 
a EZ LZ “ESE 13 
20 8 laa ime) ee 
Zu 8 alae del. 
22 AAS lak Me 
23 12 S) io acer 


*Note: Items 1-99 represent items 80-178 of the Canadian Tests of 


Basic Skills. 
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Table 5-3 (continued) 


Items Tests 


Gates- 
Metropolitan MacGinitie Seat ota Grrl Bre oe 


24 11 ji 13 10 
25 12 12 13 9 
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Table 5-3 (continued) 


Items Testes 


Gates- 


Metropolitan MacGinitie Sranrord 


Be 
54 
59 
56 
oH, 
58 
59 
60 
61 
62 
63 
64 
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70 
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Table 5-3 (continued) 


Items Tests 


Gates- 


Metropolitan MacGinitie Sbantord Cc. 
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from the number of processes required to complete a parti- 
cular item. For example, item one of the Metropolitan 
Achievement Test required 12 processes to complete the 
Beem. etbytsubtracting the five rceneral processes), mit can be 
determined that 7 selected processes were needed to com- 
plete the item. 

The number of selected processes needed to complete 
an item can be determined in the above fashion. An examin- 
ation of the table reveals that the number of selected 
processes Eequined co <completesgan itemror «the four stated 
tests range from two to eight processes. 

The results indicate that the tests do not assess 
only a single reading process as defined in this study. 
Each item was dependent upon at least two selected pro- 
cesses as well as the general processes. Contamination by 
other reading processes, then, makes assessment of a single 
reading process in the stated tests extremely complex. 

Ancanalys is: of tehe vecultstoGelable 5-3 indicates 
that a comparison between the tests reveals little in- 
formation about the processes. There is no pattern evident 
among the tests. For example, an examination of item 9 
shows 12, 8, 10 and 9 processes necessary to complete the 
Jtem im the tour estateditests (see Tables —3) "9 Mo. pattern 
WABeVLdehntaan tems weeSimibarly , mnovpakvermeoceurs imeche 
examination of all the other items. As stated earlier, the 
only information of consequence is that which relates to 
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appear to be significantly more complex than any of the 
other stated tests. The average scores for the frequency 
of use of all the selected processes in Table 5-2 are 
similar and, thus, substantiate that one test is not sig- 


nificantly more complex than the others. 


SUMMARY OF THE ANALYSIS 


l. The nature of testing reading comprehension in 
the four stated tests reveals five general processes that 
are phenomena of the test formats. The results indicate 
that some general processes are general to the nature of 
test formats. The processes may be global in nature and 
are phenomena of most reading test formats. 

2. Task demands and response modes influence the 
frequency of usage of some of the selected processes. Com- 
parison, inference, and prediction become phenomena of cer- 
tain response modes and task demands. 

3. Most selected processes had a high frequency of 
use in the four stated tests. Some selected processes, 
however, had a low frequency of use on all or some of the 
tests. Variation in the frequency of use suggests a test- 
ing of various kinds of reading comprehension. 

4. The measurement of a particular selected process 
was difficult since each item of each test requires more 
than one selected process to complete the test. 

5. The four standardized tests were similar in 


their frequency of use for the average of the selected 
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processes. 
Chapter VI contains the summary, conclusions and the 


educational implications of the study. 
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CHAPTER VI 


SUMMARY, CONCLUSIONS AND EDUCATIONAL 
IMPLICATIONS 


SUMMARY 


In this study, four commonly used standardized 
reading tests were analyzed in an attempt to assess the 
reading processes involved. The findings of this study 
have provided information that the stated tests do assess 
reading-thinking processes. The definitions for the pro- 
cesses resulted from the analyses of the tests since the 
definitions derived from the literature were found to be 
inadequate. The analyses of the four tests revealed that 
two categories of reading processes exist for the testing 
of reading comprehension, namely, general and selective 
processes. Both categories influence the processing ac- 
Eivety Of reading comprehension by? forcing Certain cog= 
nitive competency demands on the reader. The different 
demands of cognitive competencies suggest variations in the 
kinds of variables of reading comprehension assessed. 

These variations are dependent upon task demands and 
response modes of the tests which were assessed. 

The research further revealed that it is not feasible 


to assess a single reading process. Suggestions were 
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offered as to how to approach the testing of reading com- 
prehension as a processing activity, the major suggestion 
being, the establishment of a theoretical framework for the 
testing of reading comprehension. 

Five research questions have been examined in this 
study. The findings and conclusions in this chapter ad- 
dress these questions: 

1. What reading comprehension processes do the 
stated standardized reading tests assess? 

2. What is the frequency of use of the reading com- 
prehension processes in these tests? 

3. Are some general cognitive processes phenomena of 
the nature of reading tests formats? 

4. Does the test format force certain cognitive com- 
petency demands on the reader? 

5. If the assumption inherent in research questions 
Sarids4eds,round.to. bes valid, 2s.itmpocsible tosseparate 
reading and cognitive demands and devise test items to 
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FINDINGS AND CONCLUSIONS 


1. What reading comprehension processes do the stated 
standardized reading tests assess? 
Table o-lereveats thal all thersratved processes. wi en 


one exception, are assessed by the four tests used in this 


Study. @réediction, as it, is defined ih this “study. 1s not 


assessed in the Metropolitan Achievement Test and the 
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Canadian Test of Basic Skills. 

As was stated earlier in Chapter II, the rationale 
For process selection considered several factors. Fre- 
quency “ol occurrenée "consideration o1 ‘Guilford ’s models 
and paralleling the processes with the definitions of read- 
ing comprehension were the three major criteria. The 
selection of the stated processes were based on these 
criteria. Reading processes which were omitted were done 
so because they did not meet all the criteria. The raw 
and percentage scores in Table 5-1 indicate that the 
processes selected for this study were found to be present 
ti the=tests “analyzed for chis™study with =the exception of 
prediction. The frequency of use for each of the processes 


Hs discussed in mesearch question 2, 


2. What is the frequency of use of the reading comprehen- 
sion processes in these tests? 


Table 5-1 reveals that there are two categories es- 
taplished=by the frequency of use. = ihe tabbe=indreates 
that there are five processes general to the four tests 
and ten processes which are selective to the reading com- 
prenensron process, “lhe-veneral processes include» 1ecor— 
nition, association, judgement, phrase synthesis and sen- 
tence synthesis. The selected processes are prediction 
inference, classification, comparison, generalization 
(induction and deduction), sequencing, restatement and 
discourse syntehsis. The table reveals the raw and per- 


centage scores for each process for each of the stated 
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tests. 

The scores indicate a wide range in the frequency of 
use of the processes within and across tests. Table 5=2 
reveals the average percentage scores of all the processes 
Combined within and across ‘tests. The table indicates that 
thesfoun’ tests are similar an the total percentage of pro- 
cesses assessed, A comparison of Tables 5-1 and 5-2 re- 
veal that most processes had a high frequency of use when 
compared to the average scores. 

As stated earlier there are five processes general to 
the four tests. They were put into a separate category as 
they received one hundred percent scores on each of the 
four tests assessed. Since they were found to be general 
to each item of the four tests, they were grouped into a 
category called ''general processes". 

The second of the categories established by the fre- 


quency of use scores in Table 5-1 is "selected processes". 
The scores vary within and across tests. Inference, com- 
panrsonm, generalization, sequencing, and discourse syn- 
thesis were found to be above the averages of the sum of 
the percentages of selected processes found in Table 5-2. 
Prediction, classification and restating were found to be 
below the averages of the sum of the percentages. The 
variation in the scores seems to suggest that the selected 
processes are not equally assessed or approximately equally 


assessed. No criteria is being suggested by the above 


statement in relation to the frequency of use of each 
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process and equalization of scores. The only implication 


stated is the difference in scores within and across tests. 


3. Are some general cognitive processes phenomena of 
SEG aerEGenT GCE g test formats? 

As stated in question two, there were two categories 
of processes identified by the scores in Table 5-1. The 
study verified that there would be some general and 
selected processes in the tests vanalyzed (Guilford, 1960). 
Table 5-1 revealed that there are five processes general 
tO the four tests: “Thevdiscusstomtthat tollowsmsugeests 
that the five processes are general processes which are 
phenomena of the nature of the reading test formats. 

The nature of the material in reading suggests that 
the quality of the intellectual abilities and the type of 
thinking abilities engaged are determined by the material 
(Guilford, 1960). Guilford further suggests that the 
nature of testing materials and some reading materials re- 
quire general thinking abilities as well as some more 
selected thinking abilities. The types of general thinking 
abilities assessed by the tests were specific to the task 
demands of the tests. Since the task demands of the four 
stated tests are relative to reading comprehension, the 
types of general processes should be consistent across the 
four tests. The results of Table 5-1 indicate the five 
processes are general to the testing of reading comprehen- 
Sion, namely, recognition, association, judgement, phrase 


synthesis and sentence synthesis. 
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The five general processes stated above seem to be 
phenomena of the testing of reading comprehension. There 
is no suggestion that these processes are general thinking 
abilities for other types of tests. They may or may not 
be. They are stated here as being general processes to 
the task demands of the reading comprehension section of 
four stated tests. Further study could confirm or deny 
this generalization to all tests with sections assessing 


reading comprehension. 


4. Does the test format force certain cognitive competenc 
demands on the reader? 


The discussions which follow questions |. 2 and 3 
provide the necessary information to address the above 
question. Question 3 established that general processes 
were phenomena of the nature of the test formats. The 
necessity of the reader to employ these general processes 
to reading forces certain cognitive competency demands. 
Readers who are not proficient in one or more of these 
general processes could score poorly on the standardized 
tests. The standardized test would be biased to a reader 
with certain cognitive competencies in regards to general 
CoOeni tive processing. 

Simtlanriy, selected processes, force certain cognitive 
competency demands on the reader. The task demands and 
response modes oF the stated tests imiluenced” the frequency 
of use of some of the selected processes. The processes 


of comparison, inference and prediction were found to be 
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phenomena of certain response modes. The absence of pre- 
diction in the Metropolitan Achievement Test and the 
Vallaci at lest Of Paste .okL Mis mpestricts tne cOepnitlon ob 
the reader. Whereas these two tests require no use of 
prediction (see Table 5-1), the Metropolitan Achievement 
Test and the Gates-MacGinitie Reading Test requires one 
hundred percent use of the process of inference. The per- 
centage score for inference for the two tests in Table 5-1 
roe U0 percent. “Ihe necessity o1 Comparison Im tne 
Metropolitan Achievement lest and "G, 1. Bs. is=evident by 
the 100 percent scores. The necessity of these processes 
in certain tests increases the cognitive competency demands 
on the reader. In addition, the range of the frequency 
of use for the selected processes alter these demands on 
the reader. The range in the Metropolitan Achievement 
Hestswand the Csi, b.o.8 1S Erom zero, GO LO0@ percent. » ihe 
range in the Gates-MacGinitie Reading Test and the Stanford 
Aehvevement Test is from 19.2°to0 100 percent and-=1393"t0 
95 percent respectively. The scores of the selected pro- 
cesses in Table 5-1 reflect the range of such demands on 
Pneweeader. such a Lange could ereatly restrich the assess- 
ment of reading comprehension. 
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nature of reading comprehension test formats. These 
general processes force certain cognitive competency de- 
mands on the reader as do the range of frequency of use of 
the selected processes discussed in question four. The 
Findings of both these questions imply a very complex re- 
lationship between reading and cognitive demands. Table 
5-3 confirms this complex relationship. 

Table 5-3 reveals that each item of the four stated 
tests requires from 7 to 13 processes to answer one item 
of any of the tests. The great number of processes in- 
volved in the completion of an item shows the complexity 
of the responses. If the reading and cognitive demands 
created by the general processes are acknowledged and 
eliminated from the test items, there are still from 2 to 8 
slected processes required to answer a particular item. 
One single selected process was not assessed by the four 
Stated tests in even one item. From the data, if is nor 
feasible to suggest that an item can be devised to assess 


one process singly. 


EDUCATIONAL IMPLICATIONS 


The data obtained in this study leads to several 
educational implications. The first deals with a theoreti- 
cal framework. Since the discussion of the comprehensive 
process found in Chapter II does not provide for a compre- 
hensive theoretical framework of testing reading as a 


processing activity, such a framework must be created. 
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Educators and test critics acknowledged a need for a 
greater understanding of jthe reading process (Farr, 1962; 
echreiner, OL9/3)) Farrand: Schreéeinersextended that need 

to a creation of a measurement instrument to reflect 

what is known about cognitive processing. Walker (1973) 
acknowledged a similar need by stating that the field of 
reading processes has been fragmentary. Since the reading 
process and the testing of the reading process require dif- 
ferent cognitive competency demands, reading scholars 
should attempt to integrate the research into a theoretical 
framework for the testing of the reading process. 

This framework can be used to accomplish three things. 
Firstly, it can serve as a background towards understanding 
what the reading process is. Secondly, the framework can 
be used to construct new standardized tests used to assess 
the processing of a reader. Finally, the framework can be 
used to analyze other present day standardized tests to 
see how effectively they assess processing activity. 

Several factors have to be considered in constructing 
a theoretical framework for assessing the reading process. 
General processes were found to be phenomena of the test 
formats. Since the test formats affect the processing 
activities, the theoretical framework must account for 
such deviations in processing activity and the assessment 
Sf thie deviation... ‘Fieure 6.1 provides, one means, torac— 
count for change in cognitive competency demands. The 


figure allows for changes in task demands as well as an 
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Figure 6-1 


Model for Testing of Reading Comprehension 


adjusting of cognitive competency demands. The range in the 
frequency of use of the selected processes requires the 
reader to adjust his/her cognitive competency demands to the 
task demands of the test. The adjustment requires a change 
in the processing behavior of the reader. 


A second implication of the findings is the problem 


of general processes. General processes cannot be isolated 
from the rest of the processes. It is not feasible or pos- 
sible to separate processes for assessment. One suggestion 


is to create sections of tests that are designed to assess 
one single process regardless of the other processes used. 
Hor example, a. 25-1tem section miaht peadestened to jascess 
restatement. cuch ia test wouldsprovide fom, the. adequate 
assessment of this process and the evaluation of this 
process would be kept to one section. If such a test was 
too, Lengthy, then) a test. could be.created in which every 
nth duestion. assessed aj specific: process. This) second read- 
ing test could be evaluated for general reading comprehen- 


sion or could be analytically broken down to determine 
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DrLODLemise In processing activity. 

Suc an Evaluation of the readine behavior of a 
student would look at the essential functions of evalua- 
tron (Farr, 1969). “it would alco contribute tova pecter 
understanding of the reading process (Goodman, 1968). 
Findley. by Looking consistently at sub-skrils, or processes 
constituting reading, reading specialists could increase 
ine Validity or the standardized reading tests. 

In” the construction Of tests Lo assess processing 
eCelviby, UeSt constructors must cake tinto «consideration 
the content and test format. These two variables provide 
for deviation in the processing activity. The deviation 
creates a range in the frequency of use of some of the 
processes. For example, comparison, inferencing and pre- 
diction are influenced by the response modes and task de- 
mands of some of the four stated tests. A test constructed 
without the process of prediction would assess a specific 
kind or variable of reading comprehension. 

The articulation of the cognitive processes involved 
in reading comprehension is the final implication of this 
study. Although the averages of the frequency of use for 
the four stated tests were similar, the Variations in the 
asisessment Of processing activity sugeest diftterences in 
the assessment of reading comprehension. Such variations 
eould account, forvtheslack of diagnostic validity puk 
forth by Goodman (1968), Farr CLOGS )erandmoimom. .GLo7. 


Further research is needed in the assessment of processing 
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activity to further clarify the differences in assessment 
of reading comprehension. The fact that there are some 
global processes involved in the assessment of reading 
comprehension indicates that there are some psychological 
variables which influence the measurement of reading com- 
prehension. More research is needed to clarify these 
variables and to determine the exact effect of these vari- 
ables on the validity of test instruments to assess read- 
ing processes. 

When such research is completed, test constructors 
will be able to assess more accurately the specific sub- 
skills and/or processes of reading comprehension. The 
VaLtableswandsimplications put forth, inethe ibedy of this 
text should be considered in the creation of a theoretical 
framework or test for the processing activity of reading 


comprehension. 
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